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PREFACE 


The aim of this book is to provide an introduction to the methods 
of treating series of observations. The field covered embraces 
portions of both statistics and numerical analysis, and one might 
adopt the sub-title “The Combination of Observations', in the sense 
used by Brunt many years ago, to describe the contents. The 
book is intended primarily for students and graduates in physics, 
and the types of observation discussed will be those most com- 
monly met with in routine work in the physical sciences. It is 
hoped that the book will be useful as a reference work for 
statisticians and biologists, since much of the material presented 
here does not find & place in statistical textbooks but is only 
available in the original literature. 

Part I (Chapters 1 to 4) deals with observations of a single 
variable (‘curve’ of zero degree). Much of this material will, of 
course, be familiar to statisticians, and Part I is certainly not 
intended as a substitute for a good text on statistics, but rather 
as a rapid summary of those portions of statistics used in the 
reduction of routine physical measurements. Subjects such as 
analysis of variance, factorial design, etc., are deliberately omitted. 
The fitting of straight lines is dealt with in Part II (Chapters 5 
and 6). Some of the results derived in this part are special cases 
of general results for polynomials of arbitrary degree, but the fact 

that the majority of ‘curves’ fitted are straight lines warrants the 
treating of the linear case separately. Part III (Chapters 7 to 12) 
deals with the fitting of polynomial curves and of special types 
of curve. In the final chapter a number of typical examples are 
worked out in detail. These examples are intended to serve as a 
guide for those who want to fit a curve without going into the 
underlying theory. In a book of reasonable size it is not possible 
to treat all the topics relating to curve fitting, but it is hoped 
that the major topics have been covered and that other work can 
be located with the aid of the bibliography. 

There has been a tendency in recent years for books on numerical 
analysis to omit numerical examples illustrating the applications 
of the methods. In the present work an attempt has been made 
to obtain a better balance between theory and practice. Each 
method is illustrated not only with an example but also with a 
full calculating scheme, so that the beginner can proceed along 
well-tried paths. However, it is also intended that the book 
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should cover the theoretical aspects of curve fitting, and full 
. derivations of all formulae are given. A knowledge of the calculus 
is presumed, and this background should enable most of the 
derivations to be followed. Some use is made of matrix notation 
in establishing a few of the more complicated results, but only the 
very simplest matrix operations are required. 

The caleulating schemes are designed primarily for a desk 
calculating machine, although most of the calculations in the 
first two parts can be done without the aid of a machine. In 
some cases a number of different schemes are given, for it is not 
wise to be dogmatic about which scheme is ‘best’; the choice of 
the best scheme depends very much on the computing facilities 
and on the particular problem. In Section 12.1 there is a guide 
to assist in the choice of the calculating scheme most suited to 
any one of the commonly occurring types of problem. With 
high-speed automatic computers the routines for curve fitting 
will be very similar to those given for desk machines. Two 
routines for use with high-speed computers are discussed in 
Section 7.2. However, each computer has its own staff and 
manual, and the advice and instructions given by these should 
certainly be followed. 

This book was written in England and Canada while the author 
was on sabbatical leave from the University of Sydney. The 
author wishes to express his thanks to the librarians of the 
various universities he visited for the facilities placed at his 
disposal. He also wishes to acknowledge his indebtedness to his 
wife Elizabeth for her patience and care in the typing of, the 
manuscript. 

The author is indebted to Professor Messel and the Nuclear 
Research Foundation within the University of の Pay for their 
generous financial support. 


PART I 


SINGLE VARIABLES 


CHAPTER 1 


GENERAL THEORY FOR A SINGLE 
VARIABLE 


In this chapter an account is given of the theoretical concepts 
which are required for the treatment of observations of a single 
variable. The discussion is confined to those parts of the theory 
which can be developed without the assumption of & particular 
form for the frequency distribution of the observations. 'The 
practical methods of estimation based on a, small number of 
observations are discussed, and illustrated by examples. 


11 PROBABILITY AND FREQUENCY 


If a large number N of observations 7 are made of a quantity, 
and the number of these observations which have the value y is 
NM, the probability that a particular observation will yield the 
value y is defined as 


Pr {7 = y) = Pr(y) = Ut ÑIN. (1) 


The probability of obtaining a value y in a single observation is 
then by definition proportional to the frequency of occurrence of 
the value y in a long series of observations. Since > N, = N, 

Y 


> Príy) = 1. (2) 


For two variables £ and 7», the probability that a pair of 
observations yields the values > and y is written Pr{zy}. This 
probability may be evaluated by considering a large number N 
of pairs of observations. The number of pairs for which £ = x 
will be denoted by N. Of these M, the number for which 7 has 
also the value y will be denoted by N,,. Then 


N, X, N, 
P = Lt =z = Lt , 
E „ oae NN, 
and so Pr {xy} = Pr {x} Pr {y |x}, (3) 


where Príy|x) is the probability that 7 = y, given that £ = zx. 

Equation (3) is referred to as the product rule for probabilities. 
It will often be true that the value obtained for 7 does not 

depend on the value x of £. If x and y are independent, so that 


Pr {y|z} = Pr {y}, 
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then the product rule takes the simpler form 
Pr {ay} = Pr (z) Pr (p). (4) 
Since (3) can also be put in the form 


Pr (zy) = Pr {y} Pr {z]y}, 
it follows that 


Pr {x| = Pr {x} Pr {y | z)/Pr {y}, (5) 
or, for variations of z with y fixed, 
Pr {x| yj Pr (z) Pr {y |=}. (6) 


The proportional relation (6) is referred to as Bayes’ Theorem. 
The three terms are called the posterior probability (i.e. the 
probability after y is fixed), the prior probability (before y is 
fixed), and the likelihood, respectively. 


1.1.1 Notation ; 

The symbol f(y) will be used for the probability, Pr () = y}, 
that the observation or measurement will yield the value y. 
Usually the possible values y are not discrete, but form a con- 
tinuous set. f(y) is then defined so that f(y)dy is the probability 
that the observation lies in a range dy centred at y. Thus f(y) is 
referred to as the probability density function. It is also called 
the frequency function, since the probability of an observation 
lying in a given range is by definition proportional to the frequency 
of occurrence of values in that range in along series of observations. 

For a discrete distribution, from (1.1,2), 


xf) = 1, (1) 
v 
and for a continuous distribution the sum becomes the integral 
[ranas = 1. (2) 


The probability integral or the distribution function is the 
integral of the frequency function. It is often denoted by F(y), 
but here, following the usage of the Biometrika Tables for 
Statisticians, the symbol 


y 
Py) = [^ fdu (3) 


will be employed. The probability integral P(y) gives the proba- 
bility that an observed value will be less than or equal to y. The 
differential of P(y) is 


GP(y) = Ply - dy) - Ply) = f(y) dy. (4) 
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The probability that an observed value is greater than or equal 
to y will be denoted by Q(y). Thus 


Q(y) = 1— P(y) = au. (5) 


If x and y are independent, then from (1.1,4) the probability 
that z and y lie simultaneously in the ranges dx and dy about 


z and y is 

* Ti) faly) de dy. 
If this probability is written f(x,y)dxdy, where f(x,y) is the 
combined frequency function, then, when z and y are independent, 


S(x,y) = fi) fay). (6) 


1. 2 EXPECTATION AND VARIANCE 


If à very large number of measurements y of a quantity are made, 
the fraction of the observations lying in the range dy about y is 
identical with the probability that a single observation lies in that 
range, both being equal to f(y) dy. The average Y of the measure- 
ments as the number of observations approaches infinity is given 


by 
. gm I uf (y) dy, 
and is often referred to as the expectation of y, written E(y). Thus 
E(y)- Y = [uten dy. (1) 


Y is also referred to as the population mean, the ‘population’ 
being simply the aggregate of all possible observations y. 

If y and z are two variables, not necessarily independent, and 
their combined probability distribution is described by the fre- 
quency function f(y,z), so that F, z) dy dz is the probability that 
the observations lie simultaneously in the range dy about y and 
dz about z, then the expectation of the sum of y and z is 


E 0 +2) = f (y +z) f(y, z) dy dz 


= fo fro z) dz dy + f«fro. z) dy dz. 


Now (, z) dz gives the probability density for y when the second 
variable lies in the range dz about z, and so the integral of this 
quantity over z must be f(y). Hence 


E(y +z) = E(y)+ H(z), (2) 
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and the expectation of a sum is the sum of the imdividual 


expectations. 
For the product, if the two quantities are independent, 


Eta) = foo. ai d. = | [aan ae) dy ae, 


and so E(yz) = E(y) E(z). (3) 


The expectation of the product of independent variables is the 
product of their expectations. 

The variance of a quantity is defined as the average of the 
squares of the deviations from the population mean Y. In 
symbols vary = Bly- Y}. 


The square root of the variance is called the standard deviation 
or the standard error, and is denoted by o. Thus 


vary = c? = E(y- Y} = | - Te dy. (4) 


The variance is clearly a measure of the spread of the observa- 
tions about the population mean. 
Since E(y) = Y, 


E(y— Y? = E(y?) -2YE(y) + Y? = E(y?) V, (5) 
a result often useful in calculations. c> X- X i 
The variance of the sum of two quantities is 
E(y+z—Y—-—Z)? = E(y— Y)?+ Ez — Z)2 --2E(y ) (z — Z). 
The last term is the quantity defined as the covariance of y and z, 
cov (y, 2) = E(y — Y) EZ). (6) 
Then var (y +z) = vary+ var z + 2 cov (y, 2). (7) 
If y and z are independent, it follows from (3) that 
E(y T) E-) = {Ely — Y) (B(z —Z)) = 0. - 
Thus when y and z are independent 
cov (y, 2) = O, (8) 
var (y +z) = vary A vara. (9) 
The variance of the product yz can be obtained by expanding 
PG YZ} = E(Z(y - Y) - Y - Z)- (y- Y) z - 2p. 
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If the quantities y and z are independent, then, using (3), 
E(yz— YZ)? = Z° E(y — Y? + Y! E — Z)2 + E(y— Y)? (z — Z)2, 
the other terms vanishing since E(y— Y) = 0 = E(z —Z). Thus 
var yz = Z? vary+ T var z (vary) (var z). (10) 


Usually the last term is much smaller than the others, and the 
approximation 
var / = Z? vary + Y?varz (11) 
may be used. 
If d(y, 2, ...) is an arbitrary function, then 


$9,2.)- 4X,Z,..) 25g - ¥)+ 8 (e-Z)... (12) 


If the deviations of the observations y from the population means 
Y are small, the higher order terms in the expansion (12) may be 
neglected, and so, by (2), 


ECS. 2. . ) = C. Z.. ). (13) 
If the variables y,z,... are independent, 


Eily, 2, ...) (T, Z, . ) = (ze) E(y - Y? 
* (25 x) E(z-Zy4- 


2 
or var$(y,z,...) = (55) vary+ (27) varz+.... (14a) 
When ó(y,2, ...) is à product of powers Cn, then from (14a) 
var a?vary b var 
= - y? š = = +... , (145) 
S. D. ? (a S. D. /? ( S. D. 2) 
or C -( Y )«( Z ) — (14c) 


1.3 TYPES OF OBSERVED QUANTITY 


The quantities observed in practical cases would appear to fall 
into one of two classes. Firstly, there are those quantities which 
are constant in magnitude, and which will be referred to as 
‘controlled’ quantities. Many physical quantities are of this 
type—for example, the mass of a body, the velocity of light, 
etc. Secondly, there are those quantities which are inherently 
variable, the value of the various members of the population 
being distributed according to some frequency function f(y). 
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Such quantities will be referred to as *uncontrolled' quantities. 
Many of the quantities occurring in the biological sciences are of 
this class. Typical examples are the heights of men, the milk 
yield of cows, etc. 

For controlled quantities, the observed value, population mean 
and true value all coincide, and an error-free observation will 
yield the true value Y of the quantity as determined by the 
experiment. There may, of course, still be unallowed-for syste- 
matic errors which cause the value Y to differ from that given 
by other experiments. For uncontrolled quantities an observation 
will yield à value y whose expectation is the population mean Y. 

Either type of quantity may also be subject to experimental 
errors of observation. These errors are regarded as random 
quantities, equally likely to be positive or negative for any 
particular observation, which are produced by slight transient 
and unaccounted changes in the experimental conditions and 
apparatus. Thus if / is the error-free or corrected value corre- 
sponding to an observed value y, the error is 


8-y-y, (1) 
and the assumption of randomness leads to 
E(8)= O, EO) =. 2) 
For controlled variables y' = Y, and 
E(y) = E(y') = Y, (3) 


so the population mean is the true value, while 
vary = var” + varë = var ë (4) 
and the variance is a measure of the experimental error ô. 
For uncontrolled quantities, 

Ely) = B(y') = Y = Y', (5) 
and the population mean is unaffected by observational errors. 
Also , 
vary = vary’ 4 var ó, (6) 
and the variance of the observed quantities y is greater than that 
of the error-free quantities y'. 


14 ESTIMATION 


In most cases the frequency function f(y) is not known in detail, 
and a very large number of observations would be required to 
determine it. But the number of observations available, often 
referred to as the sample, is usually comparatively small. Hence 
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some method of estimating the true value or population mean is 
required when the number z of observations y; is small. 

An estimate Y is said to be unbiased if its expectation is the 
true value Y of the quantity. Now any linear function 


LU 
DA Yi 
will provide an unbiased estimate of Y, since 
R| Snu) = ÈN EU) = VEX 
= i-i 1 


and so ELEAN // LAH] = Y. (1) 


Which estimate will be the best depends on what is adopted as 
the criterion of ‘best’. The most common criterion is a least- 
squares one, in which the estimate f is chosen so that 


Ev? = X(y;— Py (2) 
should be a minimum. Then differentiation leads to 
Z(y,— 7) = 0, 
or Y = Zyn = g, (3) 


where # is the sample mean. Thus the estimate obtained from 
the least-squares postulate is just the sample mean. This is the 
estimate almost always adopted. A discussion of other postulates 
is given in $ 1.6. 

The standard deviation c can be estimated in terms of the 
deviations from the mean, usually called the residuals. For the 
ith residual 

V, = JJ. i (4) 
E(w)-E(y7n'ZEyj) ~ 
= E((y; T) - n3 L(y; — Y)? 


= E((n— 1) n7(y, T) -n? > (y; T). 
ji 


If the observations are independent, E(y,— T) (/- Y) = O, and 
E(v;) = (n —1)*n-? vary 4- n-?(n — 1) var y, 


a 59-1 _ % 一 - 
or Ee = ーー var 2 (5) 
Hence the quantity s? defined by the equation 
8? = Xwi/(n— 1) (6) 


will provide an unbiased estimate of the variance o?. Of course, 
s will also provide an estimate of the standard deviation c. It is 
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interesting to note that s is not an unbiased estimate of c, though 
the bias is almost always negligible. This point is discussed in 
8 2.5.3. 

Xv? may be calculated by evaluating the individual residuals. 
It may also be calculated from the formula 


Ew = T. Ve = Zy- ng. (7) 


In estimating the standard deviations of combinations of 
observed quantities, it is usually necessary to replace in (1.2,9), 
(1.2,11), and (1.2,14a), the population means and variances by 
their estimates 7 and s? respectively. 


1.4.1 The arithmetic mean 
The mean has been adopted as the best estimate of the popula- 
tion mean or true value Y. Since it is a linear function of the 


observations, " P 
var ダー ni vary. (1) 


Thus, using (1.4,6), 
stg) = Zei/n(n — 1) (2) 


will provide an unbiased estimate of the variance of the mean 7. 

It is perhaps worth while to emphasize the distinction between 
o(y), the standard deviation of an observation, and o(#), the 
standard deviation of the mean. The standard deviation of an 
observation is a measure of the spread of the individual observa- 
tions about the true value or population mean, and its magnitude 
does not decrease as the number of observations is increased. 
The standard deviation of the mean does decrease as n is increased, 
being in fact proportional to . The larger the number of 
observations, the less the expected deviation of 7 from the true 
value or population mean. 

Hence, for a controlled variable subject to error, increasing the 
number of observations will increase the accuracy of the estimate. 
But there is usually a practical limit to the number of observa- 
tions that it is profitable to make, since there will almost certainly 
be undetected systematic errors which are not reduced by 
increasing n. 


1.4.2 Example 


In this example the refractive index u of a glass prism will be calculated 
from measurements of the angle A of the prism, and the angle of minimum 
deviation 0 for a ray of light passing through the prism. In any text-book 
on opties it is shown that 

_ sin }(A +0) 


sin 34 (1) 
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The first step, the calculation of the mean values of A and 0 from the 
observed values, is set out in Table 1.4.2. The residuals v; and the sum 
Xv} have been calculated directly. As a check on the arithmetic, Xv? is 
also calculated from (1.4,7). The estimates of 4 and 0 are 


A = 60? 27-0 +13, 0 = 48° 28-2’+ 2-3’, (2) 
Hence the estimated refractive index is 
sin 51° 57-6’ 

= n 80° 18-67 15645. (3) 


TABLE 1.4.2 
Calculation of mean angles for Example (1.4.2) 


43? 29* 
43? 16' 
43° 18’ 
43° 357 
43° 287 
43° 34’ 
43° 30° 
43° 257 
43° 27’ 
43° 40’ 


Mean 60°27’ Xv} = 150 Mean. 43°28-2 Xo} = 487 
Check LA! 104? = 7440-7290 Check X602— 100? = 8440—7952-4 
(A.) = (Zoi/(n—1)5 = 4-1’ 8(0;) = (Zwi/(n 1) = 7-4 

s(A) = n-às(A,) = 1-3’ s(5) = n> s(0,) = 23 


Now 


ôu _ cosk(A+0) sin 364 ＋0) co 4 U 
84 ^ 3snj4 ^ Ten = iu[cot (4 +0)—cot 44], (4a) 


4. = yu cot MA +6), (4b) 
2 2 
and var = (24) var 4 + (25) var 0. (5) 


Hence substituting for the values , A, 0, vary, varÓ, the estimates 
(2) and (3), 


ðu 0. 8 _ 0. 6 
2⁄ = 0-467u, 20 0:391u, (6) 
2 
and var u = 1-56452[1-32 x 0-467? + 2-32 x 03915 [559] , 
— ^ . 4 — — = Ue ` 7 
or S.D. = 1.5645 [1-18] 180860 0-00049 (7) 


12 SINGLE VARIABLES 


The last term in square brackets converts the standard deviation of the 
angle from minutes to radians, since in the formulae (4) and (6) for the 
differential coefficients the angles must be in radians. 

The final estimate for the refractive index is then 


u = 1:5645 + 0-0005. (8) 


15 OBSERVATIONS OF DIFFERENT 
WEIGHT 


In many cases the observations y; are not all of equal precision. 
In general the values y; may belong to different populations 
whose means are all equal to Y, but whose standard deviations 
c, are different. Then, since o? is a measure of the expected 
deviation from the true value for the observation y; the obvious 
generalization of the least-squares principle is to minimize 


E(y, — Y Joi. 
Clearly this is equivalent to minimizing 
Xw,-XIw(yu-Y)y C (1) 
where w; = o? Jo? (2) 
and o is a constant of proportionality. 

The quantities w; are called the weights of the observations. 
The relative ratios of the w, are fixed by the o,, but their magni- 
tudes may be adjusted to any convenient values by altering the 
constant o. From (2), for a given set of magnitudes w;, c is equal 


to the standard deviation of an observation of unit weight. 
The least-squares estimate of Y is given by 


Ew(y;— 7) = 0, 
or fP-2g-XwyJXw,. ` (3) 


9 is called the weighted mean. 
The variance of the weighted mean is, from (3), 


" w; Y 
varg = A200 of. 
Thus o°(9) = rot, (4) 
1 1 
asc mE SS... 
e*(g) c*(y;) 
In choosing the weights, estimated standard deviations s(y,) 


will usually have to be employed instead of the population para- 
meters c(y;). Then the estimated standard deviation of the mean 


or 


(8) 
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will be of the form 


(9)? = Dael), (6a) 
or 6200) = o*[Zu;, (65) 
where w; = c?[s*(g;). (6c) 


These formulae for the standard deviation of the mean are not 
quite accurate, since the weights w; are experimental values and 
so would vary somewhat if the experiment were repeated. Taking 
this into account, Meier (1953) derived the formula 


"VE. 4 , 
etg) = Ta fı + Gu ee Dees wn Š (7a) 
where m = . (7b) 


n; being the number of observations used in calculating the value 
s(y;). The correcting factor in brackets will be small if the n; are 
reasonably large. 


1.5.1 Example 


Two separate determinations of the refractive index of a prism yield the 


values 
pa = 1-5645 + 0-0005, Ha = 1:5637 + 0-0009. 


The weights will be taken as proportional to s7?. If for convenience c? is 
taken as 25 x 81/108, 


w, = o*/s? = 81, wg = o7/s2 = 25, 
and the weighted mean will be 


= iln Vals _ 81x Ligas 16097 1.3643. 

From (1.5,6a), 
be 100g. 25 = 8125 10. 

or () = 0-0004. 
Alternatively, from (1. 5, 6b), 

a(t) = MD = 104% 26 x 81)//(254- 81) = 0-0004. 
Hence the estimate of ; obtained by combining the two separate determina- 
Mons ts p. = 1-5643 + 0-0004. 


If the numbers n; of separate observations from which the values u, and 
Ha were calculated are 10 and 11 respectively, the correcting factor in 
(1.5,7) is 

1+ (4/106?) (81(106—81)/9 + 25(106—25)/10} = 1-152, 


and so the standard deviation of Z should be increased by 7%. 
CARNEGIE iNSTITGTH * 
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1.5.2 Deviations from, the weighted mean 
The variances can be estimated from the deviations 


ー 


9 = 9«— 9 
of the observations from the weighted mean. For 


LEwj(y;— =" 


Bw) = Bju- )- 52 


W; w? 
- ュー と ) 02 + mu -— 
Le 7t 2 Eup 


1 1 
OC Lo u u U 2 
and so E(v?) = に 5) 02. (1) 
Hence E(=w,v?) = (n — 1) o2, 
and so 82 = Dw, v2/(n — 1) (2) 


will provide an unbiased estimate of the variance of an observa- 
tion of unit weight. 

The estimated standard deviation of the weighted mean can 
then be obtained by inserting s? in (1.5,4). Thus 


520) = Xw,v?|(n— 1) Ew, (3) 


wil provide an estimate s(g) of the standard deviation of the 
weighted mean. 

A special case which sometimes arises is that in which the y; 
are themselves means of n, individual observations /, the obser- 
vations in all the groups having the same standard deviation o. 
i of = vary; = nj! vary, = n;o*. (4) 
Hence the y, should be weighted as n; the number of separate 
observations in the group whose mean value is y;. Thus 


Tn, i n. (5) 
and s°(g) = Zn(y; — J⁰ n 1) En. (6) 


Formulae (5) and (6) may be of advantage when the number of 
original observations is very large, and it is desired to reduce the 
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arithmetical calculations. The value 


97 = Z Vn = > n. 


is the same as the arithmetic mean of the original observations. 
But if accurate estimates of c are required, it is very much better 
to use the residuals of the original observations % from g, the 
formula being 


s*(g) = Zu n. — 1) Ery. (7) 


1.5.3 Choice of appropriate standard deviation formula 

A question of practical importance is which of the two formulae 
(1.5,6) and (1.5.2,3) for the standard deviation of the weighted 
mean should be used in any given case. It is, however, difficult 
to give a rule which covers all cases, and the choice is often a 
matter for individual judgment. 

If the weights w, and the standard deviations s(y;) are known 
fairly accurately, then the estimate / Cu, using (1.5,6) will 
usually be the more accurate one. In fact, if errors in the w; are 
negligible, the ratio of the variances of the two estimates is 
(Tn, - 1/ n — 1), as in § 1.6.3. But if it is suspected that the 
observations are discordant—that they do not all correspond to 
the same population mean or ‘true’ value Y, but possess syste- 
matic errors—then the formula / Lu, will greatly exaggerate 
the accuracy of j as an estimate of the physical quantity being 
measured. In such cases (1.5.2,3), which uses the residuals from 7, 
is much more satisfactory. It might be objected that it is not 
reasonable to combine discordant observations, but such a pro- 
cedure is often unavoidable when the best value of a physical 
constant is required from the separate values obtained by different 
observers using different methods. It is recommended that s(7) 
be evaluated by both methods if it is suspected that the y; 
might be discordant. 

A test for the homogeneity of different sets of observations— 
that is, for equality of both Y and c for all sets—is given in 
83.6.2. If this test can be applied, and if it shows that the 
hypothesis of homogeneity is reasonable, the observations may 
all be pooled together to give a single set. 


1.5.3.1 Test for concordance. It is shown in $ 2.5.2 that, when 
the values y; all have the same population mean or ‘true’ value Y, 
Zw;(y;— 5) / is distributed ‘as x?’ with n— degrees of freedom. 
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Hence the value of this quantity will provide a test for the 
concordance of the observations. Details of tests using x? are 
given in later chapters, but it is sufficient to state here that if 
Vx? — (n — 1) is greater than 2 the observations are most probably 
discordant, while if this difference is less than 1 there is no 
reason to suspect discordance. 

When the weights w; are merely estimates based on s?(y;), the 


tit m " 
n Zw,(y,— Heſ os = E(y,— Heſs(%% 
is still distributed approximately as x? provided the numbers n, 


of individual observations used in calculating s?(y;) are not too 
small. 


1.5.4 Example 

Table 1.5.4 gives values of the ionization potential V for the hydrogen 
molecule obtained by different observers (Worthing and Geffner, 1943, 
p. 198). The errors specified are the so-called probable errors, r, = 0-67s, 
(82.2.3). Taking c as 1/0-67 = 1:33, and the weights as equal to 1/rj, the 
values w; are obtained. The weighted mean is 


V = Zw, V/ Dub. = 22061/1429 = 15:44. 
If the possibility of systematic errors is ignored, (1.5,6b) gives 
s? (V) = /. = 133/1429 = 0-001238, (1) 
and s(V) is 0-035. 


TABLE 1.5.4 
Ionization potential V for H, (Example 1.5.4) 


V (volts) 40; v; wv? x? u. v/o 
16-5 +05 E + 1:06 4-5 2:5 
17-1 +0:2 25 4- 1:66 68-9 39-0 
15-6 x01 100 4 0-16 2-6 1:5 
15-4 +01 100 一 0.04 0-2 0-1 
15-6 +0-1 100 +0-16 2:6 1:5 
15-37 + 0-03 1100 — 0-07 5:4 3:1 

Sums 1429 — 84-2 47˙7 


The residuals v, from the weighted mean are listed in the third column of 
Table 1.5.4. The value Zw; v? is 84-2, and so from (1. 5. 2, 3) 


s*(V) = Dw, /n — 1)Zw, = 84:2/5 x 1429 = 00118. (2) 


Since this is considerably greater than the value (1), systematic errors 
would be suspected. The x? test for concordance gives 


VX —4(n —1) = J (Zw, v/o — J(n —1) = 6:91—2-24 = 4:67 


and so it seems certain that systematic errors are present. 
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The major contributor to x? is the second observation, and it would seem 
desirable to perform the calculations with this value omitted. For the 
remaining five observations the calculations are shown in Table 1.5.4a. 
The weighted mean is 


V = Dio v. / Ob. = 21633/1404 = 15-41. 
From (1.5,6b), 
s? (V) = c*?[Zw, = 1-33?/1404 = 0-001260, 


and s(V) is 0-035. The residuals from the weighted mean are given in 
Table 1.5.4a, and from (1.5.2,3) 


s? (V) = Xw,vi|(n—1)Ew, = 13-73/4 x 1404 = 0-00244, 
and s( V) is 0-049. The X? test for concordance gives 
J(Zw, v3/0%) — J(n —1) = 2-79—2 = 0-79. 


Since this is less than unity, discordance is not indicated, and while the 
values are perhaps not completely concordant, the major systematic 
discrepancy has been removed by the omission of the second value in 
Table 1.5.4. The adopted value of V would then be 15-41 + 0-05. 


TABLE 1.5.4a 
Calculation of V when the second value in Table 1.5.4 is omitted 


V (volts) Wi の 。 wiv? x? u v/o 
16-5 4 0˙5 4 + 1:09 4-75 2-69 
15-6 +01 100 + 0:19 3:61 2-04 
15-4 +01 100 — 0-01 0 0 
15-6 +0-1 100 +0-19 3-61 2-04 
15-37 + 0-03 1100 — 0:04 1-76 0-99 

Sums 1404 ーー 13-73 7.76 


1.5.5 The combining of discordant observations 

There are three possible procedures in combining discordant 
observations, corresponding to the three following choices for w;: 

(a) w; oc sç; 

(b) . 1; 

(c) w; oc 1/(s2 ＋ %), s; an estimate of the likely systematic error. 

Ideally, the weights should be determined by the total (syste- 
matic plus random) errors of the observed values. Procedure (a) 
assumes that the random error s; is also & measure of the syste- 
matic error s;. It is certainly often reasonable to assume that the 


scatter of the observations as given by s?(y,) will be a measure 
of the accuracy of the method, and, by inference, of the likely 


3 
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systematic error. However, this will by no means be true in all 
cases, and the computor is clearly at liberty to vary the weights 
to correspond to what he believes to be the most likely systematic 
errors, as in procedure (c). His task is often made more difficult 
by uncertainty as to what the observer's final quoted error really 
represents. Some workers quote an error corresponding to s(y;), 
determined from the scatter of their observations, while others 
make & more or less arbitrary allowance for possible systematic 
effects in determining the final error. It is certainly the duty of 
the observer in his report to state clearly how he arrived at his 
quoted error. 

Procedure (b) ignores the random errors, and adopts the simple 
arithmetic mean. This corresponds to the assumption of a single s' 
for all observed values such that s'» s; 


1.5.5.1 Example 


The three procedures described in Section 1.5.5 will now be applied to 
the six observations of Table 1.5.4. Procedure (a) has already been applied 
in $ 1.5.4; it leads to the estimate 15-44 + 0-11 volts. Procedure (b) gives 


V = =V;,/n = 15-93, X(V,—V):- 2-5061, 
(F) = (Z(V,— V)*/n(n — 1) = 0-289. 


There are obviously many different forms of procedure (c). In one form, 
suggested by Cochran (1954a), s' is assumed the same for all observations, 
and it is calculated from the estimated total variance Z(y,—)*/(n I) by 
means of the equation 


8?+Esi/n = Z(y,—y)*/(n — 1). 
In the present example 
8% = 2-5061/5 — 1-33? x 0-3209/6 = 0-4066, 


d 1 

w . = 04066 + 1:93 ri" 

This leads to the following weights: 1-18, 2-09, 2-36, 2-36, 2-36, 2-45. Then 
V is 15-85, with an estimated standard deviation 1 Dio, = 0-280. In this 
example the semi-weighted mean given by procedure (c) does not differ 
appreciably from the simple mean given by procedure (b). The assumption 
that the probable systematic errors are equal for each observed value is of 
course not very realistic in this case. 


16 POSTULATES LEADING TO THE ARITHMETIC 
MEAN 


It is shown in $ 1.5 that the least-squares postulate leads to the 
weighted mean as the best estimate. It is possible to show that 
at least two other postulates lead to the same ‘best’ estimate. 
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1.6.1 Minimum variance 
As shown in $ 1.4, any linear estimate 


Y = Dh yE (1) 
is an unbiased estimate of P. The variance of f is 
A 
var = Dat, GA y? (2) 


The minimum variance postulate states that the best estimate 
is that which leads to the least value of var P. Hence the À; are 
to satisfy 


x var Y = 20 EN o2) (ZA)? 


- is m 2(222 o?) (CMN) = 
Or Ay oF = (Mf QA, 
Since the right-hand side is 5 of j, 
yo} = Arok, 
or Ay =. ot[oj, (3) 


where c is a constant. Hence A, is identical with w; defined by 
(1.5,2), and the minimum variance estimate (1) with À; given by 
(3) is just the weighted mean. 


1.6.2 Maximum likelihood 
The probability of obtaining a set of values y; given f;(y;), is 


proportional to " 
L = Ali Y). (1) 


L is called the likelihood function. It will, of course, be a function 

of Y. The principle of maximum likelihood states that the best 

estimate Y of Y is that which when substituted in (1) makes L 

a maximum. That is, f is the estimate for which the probability 

of obtaining the values y; which were actually observed is a 
maximum. Then 

== — log L = 0. 2 

* 37 05 (2) 

Clearly little can be done unless the form of f(y) is known. 

If it is assumed that the deviations follow the so-called normal law, 


f(y| Y) cc exp( — (y — ¥)?/20%}, (3) 
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R の 
then (2) gives 2f > (y;— e! = O, 


or 0 ) / = 0. 

Hence the maximum likelihood estimate is 
f = Qu, // Dios, 

where WiC o;?, 

and so is just the weighted mean. 

Of course, if the function f(y) is not of the normal type, the 
maximum likelihood estimate will not be equal to the weighted 
mean. The form of the deviation law would usually have to be 
assumed on somewhat meagre grounds; in most cases it will 
have some symmetrical form not very different from (3). So it is 
probable that the least-squares estimate and the maximum likeli- 
hood estimate will be very nearly equal. Since the former estimate 
is unbiased and readily calculated, it will almost always be 
adequate. It is interesting to observe that the least-squares 
estimate is identical with the minimum variance estimate, what- 
ever the form of f(y). 


1.6.8 Efficiency 
The efficiency of any estimate f may be defined as the ratio 
of the variance of the least-squares estimate 8 to that of Y. 
In symbols, 
Far o) 
x TU S 1 (1) 


Similarly, the relative efficiency of two estimates may be defined 
as the ratio of their variances. 

As an example, suppose that there are »—1 observations of 
unit weight and one of weight w. For the simple arithmetic 
mean $ = Ly,/n, 


varf = nE vary, = n-*o*(n—1--w-l). 
For the weighted mean g, 
varj = o?/(n — Lum). 


Hence 7( の  nf(n —14-w)9 (n — 1-7) 
$ 1 — w+ (2) 


n 
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In such a case the simple arithmetie mean would be quite efficient 
if w does not differ too greatly from unity and is not too small. 
Again, since the variance of the estimated standard deviation 
s(g) can be shown to be proportional to (n—1)-! (§ 2.5.3), the 
relative efficiency of the estimates (1.5.2,6) and (1.5.2,7) is 
7 = (n— / (Zn; — 1), 


which will usually be quite small. 
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1.7.1 Characteristic function and cumulative function 


The characteristic function の (の corresponding to the frequency 
function f(y) is defined by the equation 


60% = | ee7 の a) 


i being the symbol indicating the imaginary part of a complex 
number. の (7) is referred to as the Fourier transform of f(y). 
Equation (1) may also be written 


の (の = E(ettr). (2) 

The moments u; of the distribution are defined by the equations 

um | の = By). (3) 

In particular, uli 2 F. (4) 
Then, from (2), 

$(t) = EXGtyy|r! = Buz(üty /i. (8) 


(t) is a moment-generating function, in the sense that the 
coefficient of (it) /r] in the expansion of $(f) as a power series in £ 
is the rth moment u. 

The moments about the mean are defined by the equation 


m= |w- vy = Bu- YY. (6) 
Thus Hy 0, p=. (7) 
The function b(t) = log A(t) (S) 


is called the cumulative function. If this function is expanded 
in powers of it, in the form 


(t) = Nit) rl, (9) 
the coefficient , is called the cumulant of order r. 


22 SINGLE VARIABLES 
The expansion of (f) can be accomplished by writing (S) as 


ゅ (9 = log Ë » Alt) /r | 


and using the logarithmic series. Thus 


b(t) = (Zu, (it) r} Nuit) + Hy, (yr —..., (10) 


and the cumulants can be expressed in terms of the moments by 
comparing powers of it in (9) and (10). The first few expressions 
are 


1 -u- Y, «a= p-p, car (11) 
Ka = pa 48 ja — Bug? + 12us wy? — bpt. 


If the origin is chosen at the mean, the first moment is zero, 
and so, in terms of moments about the mean, 


ei = O, en = ps = d (12) 


Kg = Ma, Ky = pa — 3ps 

The cumulants are of considerable importance in theoretical 
discussions. Except for x, they are unchanged in magnitude 
when the origin of y is changed. If 

y -ytn 
then for y the characteristic function is 
$(t) = E(e^), 
while for y' the characteristic function is 
6 % = Ele) = Bleta) = est git), 

Hence Y(t) = log ず ⑰ = ity h, 


and so « is changed by 7 while the other cumulants are unchanged. 
For this reason the cumulants are often referred to as semi- 
invariants. 


1.7.2 The inverse Fourier transform 


If t) is the characteristic function satisfying (1.7.1,1), it can 
be shown that the corresponding frequency function is given by 
the inverse transform 


fa) = 52 [^ eee の gw (1) 
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Hence if the characteristic function is known the frequency func- 
tion can be determined. 

The integral (1) can be most easily established as the limit of 
the familiar Fourier series 


p(t) = XA(ro)cosrot + XB(ro)sin rot. 
In terms of complex exponentials, 
cosa = ex Tei), sina = 5; (eix — ta), 
oo 
and so $(t) = X C(rw) et, (2) 
12 — 00 
where the coefficients giving the amplitude and phase of the rth 


harmonic are in general complex. C(rw) can be obtained in 
integral form by noting that 


zo 2/o : 
| ett r-. dt = i {cos (r — g) of + à sin (r — q) wt} dt 
-n/w —n/w 


0, — 


= 2rjw, r=q. 
On multiplying each side of (2) by evi, and integrating, 
1 1 mlw * 
っ Co) = 25 . d) ed. (3) 
The substitutions gw = z,f(x) = C(x)/w, are now made in (2) and 


(3). Then w = Az, the interval between neighbouring values of z. 
Hence (2) is 


60% = X flaje*Ar. (4) 
Thus when Set) satisfies (4), f(x) is given by (3), which is 
fle) = = |” eat. (8) 
2m J /a 


On letting Az 0, in the limit if 


40 = | seede, 
then f(x) is given by 
fle) = 25 [^ gh ed. 


Thus the inverse relation (1) is proved. 
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1.7.8 Linear sum of independent variables 
If y is a linear function of » independent variables y;, 
y = XA; Yj (1) 
then the characteristic function for the variable y is 
g(t) = He”) = E II etfs ust, 


Since for independent quantities the expectation of a product is 
the product of the expectations, 


$(t) = II みあ (ん が, (2) 


where ¢,(¢) is the characteristic function for the variable y;. The 
characteristic function of a sum is the product of the character- 
istic functions of the terms. 


Hum TR 40 Nu, (3) 


and the cumulative function of a sum is the sum of the cumulative 
functions of the terms. From the definition (1.7.1,9) of the 


cumulants, 
iy, um 一 X Ky r (4) 


where «;, is the rth cumulant of the variable y;. In particular, 
if y’ = Ay, the characteristic function for y’ is 


$'(t) = (àt), (8) 
and Ke = AP Kye (6) 


1.7.4 Central limit theorem 

If the variables in a linear sum of the form (1.7.3,1) are con- 
verted to standard measure by choosing the origins at the mean 
values and changing the scales so that u, = o? = x, is unity, then 
the sum becomes 


= ç Ay 1 
y p jV; | (1) 
where Àj = (olo) X. (2) 


Since the variables are now in standard measure, (1.7.3,4) 
gives for the second cumulant 


n 

1 = NN. (3) 

If no one of the M is very much greater than all the others, it 
follows that ; " 
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For the third cumulant, 


n 
= >. D Kay o NÈ as, 


n 
and in general, Ky = DAP kgj = nH cp, (5) 
1 


If n is large the higher cumulants <, will be small, and so 
Set) > e-+", (6) 


The frequency function whose characteristic function is 
exp 一 3 can be found from the integral (1.7.2,1), 


1 (2 . 1 is ; 
Ju) = s— etu ei? dt = mee] eU, dt 
1 š cor y " 
= ua f e~it dt. 
T L 


From the theory of contour integration this integral is identical 
with ib 
i e`? dt, 
ー の 


which is shown in § 2.1 to have the value /(27). Hence in standard 
measure the frequency function for a linear sum approximates to 
the form 1 


which is known as the normal frequency function. The theorem 
that f(y) approximates to the form (7) is referred to as the central 
limit theorem. 

Clearly the larger the number n of variables y; the more nearly 
wil the frequency function approach the normal form. The 
approximation (7) is closer if the frequency functions f;(y;) are 
symmetrical, since then <s will vanish and the first additional 
term in t) will be of the order of &, or ^71. The form (7) will bea 
very good approximation to the true frequency function if the 
original variables are themselves distributed approximately nor- 
mally, for then the «y; in (5) will be small. 

The discussion is based on the assumption that à; ~n. For 
the simple mean Ln, 


Àj = (%%%) n = nd, 


and M is exactly equal to ut. For all other cases the assumption 
will þe fairly satisfactory provided no one term swamps the 
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others. It is obvious that if any one term is very much larger 
than all the others the distribution will be similar to the distri- 
bution of that term. 


1.58 NOTES AND REFERENCES 


(1.1) The simple frequency definitions of probability given here are 
adequate for the purposes of this book. There are many different ways of 
developing probability theory, each with its own proponents. An interesting 
account of the difficulties associated with the various approaches is given 
by Kendall (1949). 

(1.3) This classification of types of observed quantity is influenced by 
Berkson (1950). 

(1.4) s? can be shown to be the best unbiased estimate of o?, in the sense 
that its variance is least; see Hsu (1938), Halmos (1946), and Nagler (1950). 

(1.5) An elementary discussion of the combination of estimates from 
different experiments is given by Cochran (19542a). 

(1.7) A fuller treatment of characteristic functions and cumulants is 
given by Kendall (1948, Chs 3 and 4). 

The Gram-Charlier series can be used to expand general distributions in 
terms of the standardized normal variate X (Cornish and Fisher, 1937; 
Blom, 1954). 

The use of Pearson's distributions is described in books by Elderton 
(1938) and Brunt (1917, Ch. IX). 
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CHAPTER 2 


THE NORMAL DISTRIBUTION 


The central limit theorem gives the normal frequency distribu- 
tion a very prominent place in statistical theory, for in those 
cases where the deviations アー? can be regarded as due to the 
net effect of a number of small disturbances the frequency distri- 
bution wil approach the normal form. Thus the error 8 in an 
observation is regarded as being brought about by a number of 
small disturbances, and 8 is usually assumed to follow à normal 
distribution. The statistical tests to be discussed in the remainder 
of Part I all assume that f(y) is of the normal type. In this section 
the properties of the normal distribution will be discussed. 


2. THE GAMMA FUNCTIONS 


Certain properties of gamma functions are required in discussing 
the normal distribution. The gamma function is defined by the 
equation 


T( n) = as e dx, (1) 
or, substituting y? for z, 
T(n) - 2% N e dy. (2) 
If (1) is integrated by parts, 


T(%) = [一 -F, - 1) 2-8 e—% dz, 
0 


or T(n) = (n —1)T(»-— 1). (3) 
In particular, if n is integral, 
T(%) = (n— 1)! (4) 


since I'(1) is unity. (1) may be regarded as the generalization of 
(n — 1)! when n is non-integral. 

The value of T'(2) is often required. It can be found by con- 
sidering the double integral 


co co Go 
f e f e-v* dy dz = ff e-G'ry! da dy. (5) 
—co —co 一 0D 
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Changing to angular coordinates z = r cos 0, y = rsin 0, the right- 
hand side of (5) is 


n L: e dr d = sra e" 4dr? = m, 
while the left-hand side of (5) is 


2 f tec Ë j M, ay) dz = (TP. 
Thus I(3) = Jz. (6) 
2.1.1 T'he normalizing factor 


The normal distribution is, for a standardized variable with 
zero mean and unit variance, 


S(x) = Ce, 
the form given in (1.7.4,7). For & non-standardized variable y, 
X = (y — Y)/c, and so 
tly) = Ce--F)*/20*, (1) 
The value of the normalizing factor C is found from the condition 


that Í f(y) dy is unity. Since 
[ e—(u—Y »/20* dy = 2| (Go dz = 4(2e?) T'(š), 
— 0 


the normal distribution is 


1 
— e-(-Y)1/20* 
Sly) o ) V e (2) 
In the standardized form, o(X) is unity, and 
1 ' 
en (3) 


2.1.2 Moments 
The moments about the mean are 


= | w- Fyto, 
and, setting 23 6 Y)?/20, 


"2188 i 200 ey. W " ale? dz. 


So ur. = (G T(3(r-- 1)4/m, r even; 
= 0, ” odd. 
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Now 
T(&(r- 1)) = à(— 1) 1 — 3) .. 3T (4) = 2 r- 1) (r- 3) . 1, 
and so p, = ((r—1)(r—3)...1)o", + even; (1a) 


= 0, r odd. (15) 


In particular, u, = o? and u, = 304 = 3y$. 
The absolute moments when r is odd may be defined as 


B\y-¥y\ = [^ 1w- Ty 


1 = I 
“soya f erle- dz, 


or E|(y— Yy| = (e J2y THAI) / r. (2) 
The most important of these is the first absolute moment, 
E|y- Y| =I. (3) 


2.1.3 Cumulants 
The characteristic function is, if the origin is chosen at the mean, 


A(t) - 2007 KZ e—v*/2o* dy 


272 * 2 
= c (27) ded „Les e" 
and hence の (の = . (1) 
'The cumulative function is 
p(t) = — ise 


and the cumulants beyond the second all vanish. 
Conversely, if all the cumulants beyond the second vanish, the 
distribution is à normal one, as was shown in $1.7.4. 


2.1.4 Sum of normally distributed variables 
If the variables y; are normally distributed, x; , vanishes for + 
greater than 2. Hence, from (1.7.3,4), the cumulants of a linear 


"m" y = EÀ y; . (1) 
are K1 = ZA Ky, j: i.e. Y = XA; ,; (2) 
Kg = と Ke j» ie. 02 LAF oF; (3) 


k, = L,; = 0, r>2. (4) 
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Hence と ん ヶ , is distributed normally with mean ŁA, Y, and 
variance LA? var. This result is referred to as the reproductive 
property of the normal law. 


2.2 TABLES RELATING TO THE NORMAL CURVE 


The frequency curves for different normal variables differ only in 
the location of the mean and in the magnitude of the variance. 
If à change is made to the variable 


X = (y— Y)Jc (1) 
the curves will all coincide. The standardized curve is 


3 

f(X) has been tabulated by many authors. Table 1 of the 
Biometrika Tables gives Z(X)=f(X) for the range 0(0-01)6-00. 
The curve of f(X) is bell-shaped with à maximum of magnitude 
1/% ) = 0-3989 at X = 0. The second derivatives vanish at 
X = +1; these are points of inflexion, corresponding to the regions 
of steepest slope. 

The function 


> 4 
P(X) = T5 [ems (3) 


gives the probability that an observed value does not exceed X. 
This function is also given in Table 1 of the Biometrika Tables. 


The corresponding function 
T co 
X) = —— z2 qz = 1— P(X 4 


gives the probability that an observed value exceeds X. 

Inverse tables giving X as a function of Q are often more 
useful in statistical tests. Table 4 of the Biometrika Tables lists X 
for Q in the range 0(0-001)0-5. Table 2.8a is a very short table 
of this type. 

In words, the value X = 1-645 when Q = 0:05 implies that on 
the average the value of X exceeds 1-645 for 5% of the observa- 
tions. Since P(— X) = Q(X), these tables also give the probability 
of obtaining a value less than — X. 


2.2.1 Testing of observed values 

To test whether an observed value y is à reasonable one, on the 
hypothesis that the observations are distributed according to & 
normal law with mean Y and standard error c, the quantity 


= (y— Y)c 
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is calculated. The probability of obtaining a value at least as 
great as this (or as small as this, if X is negative) can then be 
estimated from Table 2.8a. 

It should be noted that this gives the probability of a single 
observation exceeding X. It does not give the probability of the 
largest of a set of n observations exceeding X. This latter proba- 
bility is given by 

Q,(X) = nQ(X) (P3. (1) 
For (1) is the product of the probabilities that (n — 1) observations 
are less than X and one observation exceeds X; the factor % 
takes into account that it may be any one of the n observations 
which exceeds X. The function Q,(X) is given in the right-hand 
half of Table 24 in the Biometrika Tables. 


2.2.2 Double-tail tests 

The tests described in the previous section may be called 
single-tail tests, in the sense that they give the probability of an 
observation lying in a particular ‘tail’ of the f(X):X graph. One 
can also determine the probability of the observation lying in 
either of the two tails. That is, the probability of obtaining a 
deviation greater than |y— Y |, irrespective of the sign. Since the 
normal curve is symmetrical, 


Pr {| X|>X,} = 2Pr{X>X,}. 


Hence Table 2.8g may also be used for double-tail tests, if the 
levels Q are replaced by 2Q. 


2.9.3 Probable error 
The value X for which 


Pr /- Y |/c 2 X) = 0:5 
is X — 0-6745. The quantity 
p = 0-6745c (1) 


is called the probable error of an observation. The probability 
that the absolute deviation from the population mean / F| 
exceeds p in magnitude is one-half. 

The probable error is widely used in physies to specify the 
spread or error of the observations. The term is practically 
unknown in the biological sciences and in statistics itself, where 
the standard deviation (also called standard error) is usually 
given. The standard error retains its significance if the deviations 
do not follow a normal law, while the probable error does not. 
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In the physical sciences at least it is very important to make it 
clear whether the error given is the standard error or the probable 
error. It should also be remembered in assessing the accuracy of 
an estimate that the probability of the error exceeding the 
standard error is about 1/3. To get something corresponding to 
a, likely limit of error, the standard error should be multiplied by 2 
or 3. From the tables 


Pr (/- TY 200 = 1/20; Pr = Y|» 300 = 1/400. 


2.3 BIVARIATE NORMAL DISTRIBUTION 


If two variables x and y, with origins at the population means, 
are each normally distributed when considered separately, 


1 1 
J(z) = an —x*/20%, fly) = e, (27) oP —y*[2ey, (1) 
the combined frequency function can contain an additional term 
ev, This extra term is allowable because, in integrating over x 
to give the normal distribution for y, it can be removed by 
completing the square, while no other term can be removed in 
this way. The general form for the combined frequency function 
is then 


_ 1 1 [a° 2pxy の 
f(x,y) = 2zo。 0 (1 — p?ji exp 2(1— p?) 62 o, 2 46 (2) 


It can be checked by integrating over z that the normal form 
for y is obtained and vice versa. The constant p is called the 
correlation coefficient. 

The characteristic function for the bivariate distribution is 
defined as 


$t) = | exp (ity dh, Ml. dard. (3) 


where f(x,y) is given by (2). If the substitutions 
E . itz og it. po,oy, Y = y ita og it po, oy, 


are made in (3), then 
1 


270, (1 — p?) 
Pe aG Eaa 


where the product, being of the form e. mae dm, is unity. 


(tr, ty) = exp - At of + 2t, t, po, Oy tty oy) 


2.8 BIVARIATE NORMAL DISTRIBUTION 33 
Thus the characteristic function is 
の (を, i) 一 (tz 2 * 2 ん ん pOz gy T の 07). (4) 
The characteristic function is à moment-generating function, 
the moment 
Hrs = E(x" y*) 


being the coefficient of (it)“ (it, )*|r! sl. Thus 
Hoo = E(x?) = o2; pos = . = of; Hay É(xy)- p905 Ty. (5) 


2.3.1 Estimation of p 
In practice the true values (assumed zero in the above dis- 
cussion) are not known, and the correlation coefficient must be 
estimated in terms of deviations from the means. Now 
E(x; — 2) (y;— 9) 
= E(x,y;) — Ex; Lin 一 Ly, Ln + E(Zx/n) (Cn). 
If the observations are independent, so that 
E(x;x;) = 0 = E(x;y;), 
then this becomes 
po, o, 1l — 7 — m7 n7) = {(n—1)/n} poz o 
and so BY (z ) (4—9) = (n— 1) pos oy. (1) 
Thus > (z, — £) (y;—3)/(n — 1) (2) 


will provide an unbiased estimate of pc,c,. Usually o, and o, 
are also unknown and must be estimated from 


(Z(z,—£)'/(n—1)P and (X(y,—9)|m— 1). 


Pan (一) (y;— 9) (3) 
(r. 2) Z(y; 9) * 
will be an estimate of the correlation coefficient p. 


Hence 


2.3.2 Expectation of product of absolute values 
In discussing the efficiency of another estimate si of c in $ 2.6.3, 
the formula 
E|z| |y |= 277! oz oll p|sin| p| - (1 — p?)*] (1) 
will be required. A brief outline of the proof of this formula will 


now be given. 
Since 


Blzllyl= [[ lel Hie Mar au, 
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where f(x,y) is given by (2.3,2), the substitution of angular co- 
ordinates defined by 


€$-—0,20080, y = o,zsin6 


leads to 
27 / の 
EI = = の == Í z?|sin 26 
o Jo 
x {exp —2?(1 — p sin 20)/2(1 — p z dz dð. 
Putting R? = z2(1 — psin 20)/2(1 — p?), 
the integral with — to the R coordinate is 工 2) = 1, and so 


| sin 28| 


o (1—psin 20)? e. 


EN * = ° zo (1—p ay" 
Replacing 20 by ¢, 


1 7. sin $ d$ 7/2 sin の の の 
zlzllyl= = の | d mg" , | 


7/2 2 
eres I, C eg 


This can be reduced by setting 
|pleos み = (1— p?)ktan c. 
The value «, of w corresponding to ¢ = 0 is sin-1| o|, and 
{1+ p? — (1— p?) tan? w} 


2 x ((1 — p?2)* sec? w dw 
B\z||y| = Zes e 1 an |" passes i 

e My” "P ((1 + p?) cos? w — (1 — p?) sin? w} dw 

2 

ese, poto ;ʒ ein 2c 


2 š 
= Za, c,[] p| sin! |p| + (1 — p°). 
This completes the proof of (1). 


2.4 THE y? DISTRIBUTION 


If the normal law holds, the probability of obtaining & value in 
the range dy about y is of the form 


C(exp — (y — Y)°/2o2) dy. 
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The probability distributions of the sums of the squares, for 
n observations, of the deviations from the true value, X(y,— Y), 
and from the mean, C/ — j)?, will be derived in $2.5. These will 
be shown to be of the x? type, and in this section the derivation 
and properties of the x? distribution will be discussed. 

If z, are v quantities distributed normally about zero with 
standard deviation unity, the probability that a particular set of 
values will lie in the ranges dz; about z, is 


dP(z,) = (C exp — 3222) II ilis (1) 


The evaluation of the probability distribution of Zz? is done most 
simply by geometric methods. With a particular set of v values 
2, is associated a point in a v-dimensional space whose coordinates 
are z, The term in brackets in (1) can be interpreted as a 
probability-density, since when multiplied by the volume element 
II dz, it gives the probability that the point corresponding to a 
particular set of values lies in that element. 

Clearly the probability-density is symmetrical about the origin, 
and a change to spherical coordinates is simply made. Denoting 
the radial coordinate by x, Lat is just the square of the distance 
of the point from the origin, and so equals x2. As regards the 
volume element, the volume of a hypersphere (i.e. the generaliza- 
tion of & sphere in v-dimensional space) of radius xy will be 
proportional to x", and so the volume of a shell bounded by two 
hyperspheres will be proportional to dx", or to "gy. Hence in 
spherical coordinates (1) will be of the form 


GP(x, 0,) = C(exp — 3x?) x' ^ dxf (84) II de, 
where the 6, are the v — 1 angular coordinates. The constant C 
here will be different from that in (1). For simplicity the same 
symbol will be used for the constant of proportionality throughout 
the discussion. Since in the integrand the radial coordinate x is 
independent of the angular coordinates 0,, these may be inte- 
grated out to give the probability distribution 


aP(x) = C(exp — 3x") x"? dx. (2) 
The range of x is from 0 to oo. From (2.1,2), 
J “exp (C- dN 2-1 Ty), 
0 
and so the constant O in (2) is the inverse of this. Thus 


dP(x) = et y» dx. (3) 


1 
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A variable whose distribution is of the form (3) is said to be 
distributed as xy? with v degrees of freedom. The abbreviation 
d.f. or D.F. is often used for degrees of freedom. 

It will be noted that (3) actually gives the distribution of x, 
but the distribution is always spoken of as a x? distribution. 
The actual form of the distribution of x? is 


dP(x°) = e yr dya. (4) 


1 
21» (g) 
2.4.1 Properties of the x? distribution 
The characteristic function, from (2.4,4), is 


— EN " ity? H AX ター2 2 
La ET |. 
1 co 
am an DERE ii — 12 2,v»—2,442 
(1 — 2it) zer» |. omie de, 


or b(t) = (1 — 24) P. (1) 
Thus the cumulative function is 
. (it)? (it)s 
lt) = log g(t) = v(1t) + 2 2 + Bu ben (2) 
and hence E(x?) =v, vary? = 2. (3) 


The distribution may be shown to be approximately normal for 
large v. For the characteristic function of x2/ (20 is, from (1.7.3,5), 


2it J 
$07 (i-a) ， 
and the cumulants then are 
Kg = 1, xš = A(8[v), x, = 12/v, eto. 
Hence for large v the distribution of X?/(2v), and so of x2, 
approaches the normal form. However, this approach is rather 


slow, and for small v the distribution is decidedly unsymmetrical. 
The probability of obtaining a value greater than a given 


value x? is - 
qn = are) 
x? 


Tables are available giving the values of y? corresponding to 
different significance levels of Q. Table 8 of Biometrika Tables 
gives values of x2 for v 1(1)30(10)100 and selected values of Q 
from 0-995 to 0-001. Similar tables are given in Fisher and Yates, 
and in the Handbook of Chemistry and Physics. Because of the 
asymmetry, tests using x? tables are always single-tail tests. 


2.4 THE x: DISTRIBUTION 37 
2.4.2 Expectation of x 


The expectation of x° is v. The expectation of y is very close 
to Jv, but it is slightly different from this value. It can be 
evaluated from 


E(x) = [xaPoo = ANE ex dx. 


Thus E(x) = ATH 1))/T v). (1) 


An approximate expression for the ratio of the gamma func- 
tions can be obtained in the following way. Suppose that v is 
odd, so that 2g — v--1 (the discussion when v is even follows 
similar lines). Then 


rgen. T(9⑦) (q—1)! —— 
My) Pa- (s-9G-9..i- 
(4-1)! (g—- 1)! 2c? 
(2q—2)!Jm ` 
The factorials may be expanded by Stirling's n 
(Whittaker and 3 1940, p. 251), 


= (2n)* (nje)? (1 + 1/12m ＋ ...). 


Then 


82 2309 — 2) (1 T — I) - (1 + (29 — 2) 2 
= 2-i(y — 1) (IT- I) -I T- 1) A 
= 2-tyi{1l — 21). 
The expression (1) reduces to 
E(x) =* - ), (2) 


the bias, or difference between E(x) and , being 13. 

The variance of x is given approximately by formula (1.2,14a). 
Thus 2 92 
var x? = し e| var x = (2x)?var x, 
where the differential is evaluated for the value of x corresponding 
to E(x). Substituting the values v for x? and 2v for var x’, 

var x = š. (3) 


The ratio of the bias in (2) to the standard deviation is thus 
}(2v)-#, and so the bias is usually neglected. Tables of EN /i 
and of S.D. x are given in the Biometrika Tables (Table 35, 
columns 2, 3, and 4). 
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It follows from (2) and (3) that 
x’ =x- (4) 
is approximately normally distributed about zero with standard 
deviation 1//2. The value of x’ for a given probability P varies 
only slightly with v, and so x’ can be very easily tabulated. 
Table 2.8b is a table of the values x’ corresponding to various 
significance levels Q. This table can be used to test whether an 
observed value of x? is reasonable or not. It is much more compact 
than a x? table, but square roots have to be evaluated. Often it 
wil be sufficient to remember that J2(VJx2— (v) is distributed 
roughly as X, the normal variate. 


2.4.3 The x? distribution with one degree of freedom 
For the standardized normal distribution 
dP(X) = f(X)aX, 
and as the distribution is symmetrical the distribution of the 


absolute value is 
E 2 
àP( X|) = 2f(X])aX = Tan) 
Comparison of this with (2.4,3) shows that | X | is distributed as x 
with 1 d.f., and X? is distributed as x? with 1 d.f. 


e-ciX'dx. (1) 


2.4.4 Addition of x? values 
If xš and xš are each distributed as xy? with v, and v, d.f. 
respectively, 


GP (y, xa) = C ex eio! y, 7 qu! dy, dya. (1) 
Transferring to angular coordinates y,0, defined by 
Xi = x cos , x2 = xsin0, x?’ = xi +x? 
(1) becomes 
dP(x, 0) = Oe yrit dy sin I cos» 046. 
On integrating over 6, 
d P = Ce te qnm dy, (2) 
and the sum x? = x? + x2 is distributed as x? with v, + v, d.f. 


2.5 THE DEVIATIONS FROM THE TRUE VALUE 


For the set of n observations y; of weights w; the combined 
probability distribution is 
dP(y;) = Cexp( — Z(y; T) / 20% II dy;. (1) 
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If the transformation 


2, = (y, T) /o. (2) 
is introduced, it is seen that (1) becomes of the form (2.4,1). 
Hence Z(y, — T) % = Xw;(y; — Y)*[o? 


is distributed as x? with n degrees of freedom. 
However, the true value Y is usually unknown, and the resi- 
duals or deviations from the mean are of greater interest. 


2.5.1 Rotation of coordinate axes 


To determine the distribution of the residuals, it is necessary 
to investigate the transformations of variables corresponding in 
geometry to pure rotations of the coordinate axes. Consider a 
linear transformation of the form 


2; = Ej Yj (1) 
with the inverse transformation 

Yi = ルッ (2) 
Then 24 = > N > HikŽk = > (z A T Zk» 
and so > A, Mite = Sates (3) 


where ô;„ is the symbol known as the Kronecker delta, taking 
the value unity when the indices i and k are equal and the value 
zero when they are different. 

If the y; are orthogonal, what conditions are imposed on the 
À,; for the z, to be orthogonal also; that is, for the change from 
the y axes to the z axes to be equivalent to a rotation of the axes 
in space? Clearly the distance of a point from the origin is to be 
Xy in the y coordinates, and Lat in the z coordinates, and so 


Dy = X NN 2 = DAF = N uu yg (4) 
r: jik 7 i jk 7 
Hence the conditions imposed on the Af are f 
DN = 9 (5) 
Also > Maj Hik 一 jy, (8) 
and, on comparing (3) and (6), 
ug = ん (7a) 


Thus the conditions imposed on the A can be put in the alterna- 
tive form > eo (7b) 
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The conditions (5) can be obtained very easily by use of matrix 


notation. For (1) is z = Ay, 


and hence (4) is zTz = XT Ay = yTy, 
amd so ATA = I = MNT, 


which is the matrix form of (5). À is referred to as an orthogonal 
matrix. 


2.5.2 The residuals 
Since Xw,;(y;—3) = O, where 7 is the weighted mean, it follows 
that the expression 
X(y;— Y)?/20} = Xw,(y,—3 + y — Y)?/20° 
can be put in the form 
E(y, — Y)?/207 = Lew, vt 20 + (Zw;) ( Y)?/20°. (1) 
If the scale of the coordinates in (2.5,1) is changed by the 


transformation " i 
Y? = yilo; = viyio, 


X(y;— Y)?/20} becomes (% — Y9)2, and the probability distri- 
bution of the y? is 


の (9) = C(exp - 3Z(yi — Y2)5 II d. (2) 
The axes are now rotated by the orthogonal transformation 
2, = Zw} y? (Zw; = (Ew) Yo; | (3) 
25,23, . 2, perpendicular to z, and to one another. 


Now the point corresponding to the true value is distant 

DZ} = TY} Tu. 7/0 
from the origin. But, from (3), 

21 = Dw, Y2Jo2, 

and so Zg, Za, , Zn all vanish, and 

2, —Z, = (Zw) (g — T). n 
Hee — Xg,—- TY L- YY G-. (4a) 
and, from (1), 3:2 = Xu,vljot. (ab) 
Then (2) becomes ° 
25 0. 0 = Clexp - Ilg Tea {oxp—4 Sei) as]. (6) 


The first term in square brackets shows that # is distributed 
normally about Y with variance o?/(Xw,). The second term shows 
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that 2,vi|o? is distributed as x? with n—1 degrees of freedom. 
The distributions of # and Nr, v/o are independent of one 
another. 


2.5.3 The estimated variance 
Since Tro: vf /o? is distributed as y? with v = n —1 degrees of 


freedom E(Zw, vf /o) = v, 
and var (Zw; v / o2) = 2. 
Hence s? = Xw,vilv (1) 
will provide an unbiased estimate of os, with variance given by 

var s? = 2o*[y. (2) 

Similarly, s will provide a biased estimate of c, 
E(s) (I- 3v), (3) 

with standard deviation 

o(8) = o/(2v)t. (4) 


Since the ratio of the bias term to the standard deviation is 
(SY) *, the bias in s is almost always neglected. In evaluating 
the accuracy of an estimate of c, the estimated value s will 
usually have to be substituted for the unknown c in (2) and (4). 

It is almost never necessary to retain more than two significant 
figures for the standard deviation, since even with 50 observa- 
tions the percentage standard deviation for the estimate s is 10%. 


2.5.4 Testing of estimated standard deviations 

From (2.5.3,1), vs2/o2 is distributed as x? with v degrees of 
freedom. Hence the tables of Q(x?) can be used to test whether 
& value s obtained in & particular experiment for which c is 
known is reasonable or exceptional. 

For the measurement of prism angle ($ 1.4.2), many previous 
experiments might have shown that the standard deviation of an 
observation c is 5’. For the observed value s = 4-1’ (Table 1.4.2), 
Xv? = 150, n = 10. Then x? is 150/25 = 6, with 9 d.f. From the 
tables, Q(x?) = 0-75. Alternatively, x’ = /6—3 = — 0-55, and from 
Table 2.85, Q(x') = 0:75. That is, a value greater than the esti- 
mated standard deviation of 4:1’ would be expected in three- 
quarters of similar experiments, and an error less than 4-l' in 
one-quarter. The value obtained in the particular experiment is 
neither exceptionally high nor exceptionally low, and there is no 
reason for supposing that the scatter is different from that 
normally present. 
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2.6 OTHER ESTIMATES OF STANDARD DEVIATION 


There are two other formulae which have been widely used for 
the estimation of the standard deviation. Both assume that the 
distribution is of the normal form. The first formula employs the 
average of the deviations from the mean, irrespeotive of sign. 
In the second the range of the observations, that is, the difference 
between the largest and smallest values, is used. 


2.6.1 Properties of the residuals 
The residuals 
v; = % = "n (n—1)y,— > J 
kj 
are linear functions of the y,, and so from § 2.1.4 they are normally 
distributed about zero with variance 
e*(v) = n-*((n — 1? + (n — 1)) e? = ((n — 1)/n] o. (1) 


The residuals are not independent but are correlated. Now 


Boyn) = n-* E(n-09,- Eva (U- Z) 


= = 206 1) ＋ (n—2)} o2, 
and so E(v,vy) = -n oè. (2) 
The coefficient of correlation is given by 
p = E(v,vy)lo(v;) o(v,), 
and from (1) and (2) j= Sa ak (3) 


2.6.2 The estimate 61 
From (2.1.2,3), 
2n— sÍ 
O, 


E|; |= ac = に > 


amd so 8, = (5) (n(n — 1) (1) 
will give am unbiased estimate of the standard deviation of an 
observation c. This is sometimes known as Peters’ formula. The 


numerical factor /(z|2) is 1-253. The approximate formula 


1:253Z|v 
s c EE (2) 


is more convenient for numerical calculations. 
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2.6.3 Efficiency of s, 
The variance of s, is given by 


vars, = E(s,—oc)? = E(s) — 02. (1) 
Now EZ | v, |}? = N uf nn 1) E |v;| | (2) 
and from (2.6.1,1), (2.6.1,3), and (2.3.2,1), this becomes 


E(Z|v,lf? 
= (n— 1) o2+ (2/m) (n — 1) o — 1)? — 13 -- sin?1((n — 1)-1)]. 
Hence 
var 8, = n o?[7|2--((n— 1)? — 15 --sin- (n —1)73) —a]. (3) 


A more useful form is obtained by expanding (3) in inverse 
powers of (1 —1). Thus 


sin-i((n — 1) = (n— 1) + 0(n-3), 
(n— 1) — 1 = (n—1)—à(» — 1) — 0(n73), 
and var si = n7! o*((z/2) + (n — 1) + 3(n— 1)71 — n + 0(n73)) 


Hence to à very good approximation 


ケー ク 
var $1 = 2(n — 1) o?, (4) 
Now, from (2.5.3,4), 
gt 
vars = 2(n—1)' 


and so the efficiency of the estimate s, is 


vars 1 
7(81) = vars, = = 0.876. 


2.6.4 Use of the estimate 61 

The efficiency of s, will almost always be satisfactory, and this 
estimate has been very popular in the past. Its main advantage 
over the estimate s is that the residuals v do not have to be 
squared. However, with a modern calculating machine this 
squaring can be accomplished very rapidly. Since s, is only an 
estimate of o if the distribution follows the normal law, while 
s is an estimate whatever the form of the law, the general use of s, 
is not recommended. 
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2.6.5 The mean range 

The range w is defined as the difference between the largest 
and smallest values in the set of » observations. The mean range 
E(w), the average value of the range for a large number of sets of 
observations, will be the difference between the mean largest and 
the mean smallest values. 

The distribution function for the largest values will be P"(y), 
the probability that n observations are all less than y. Hence 
the probability that the largest observation lies in the range 


y; y + Ay, is d 
dy (P^(y)) Ay. 


The distribution function for the smallest values is 1— Q"(y). 
For the probability that all the values exceed y is Q"(y), and so 
the probability that all the values do not exceed y, or that the 
smallest value is less than y, is 1—Q"(y). Hence this is the 
distribution function for the smallest values, and the frequency 
function is 


d 
dy 0 - 990. 
The mean range is then given by 


o d o d 
E(w) = f Jay P" (dy - [vg —Q"(y)} dy. (1) 


On integrating this by parts, integrals of the form 


[yP^(y)z, and [y(1—Q^(y)]]5. 
will vanish, since they are of the order of y e-9', which approaches 
zero as y approaches infinity. So (1) becomes 


Ew) = H M FH (2) 


If y is replaced by the standardized variable X on the right- 
hand side, (2) becomes 


Bolo) = [^ -O-. ex, (3) 


and the integral can be evaluated by numerical integration from 
the tables of P(X) and Q(X). The value of the integral is usually 
denoted by d.. Then 

E(w]o) = dp, 
and so 8g = wd, 
will provide an unbiased estimate of the standard deviation c. 
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The variance of sR can also be found from similar integrals, 
but since the integrals have to be evaluated numerically, there is 
little point in writing out the explicit expressions. Table 2.8c 
lists the values of d, and the corresponding efficiencies 7(s,) for 
m = 2(1)10. The efficiency drops off quite rapidly for higher 
values of n. 


2.6.6 Growping of observations when n is large 

If n is large, à more accurate estimate of c is obtained by 
dividing the observations into Ñ sets of v observations, finding 
the range w; in each set, and hence the mean range Dw,/N. 
Then the estimated standard deviation obtained from the ranges 


of the groups is sor = Duo, / Vd. (1) 
The variance of this estimate is 
var Sar = N- var sp(v), 


while for the estimate s, 
2 


— m 
2(n—1)  2Nv 
Hence the efficiency of the grouped estimate is 
(s ) = i S555 : 
nter = 3, S. P. SRU 
Using the values for the last term tabulated in Table 2. Sc, the 
efficiencies for > = 2(1)10 listed in Table 2.6.6 are obtained. It is 
seen that the efficiency is about 0-75 in the range v — 6 to 10. 


TABLE 2.6.6 


Efficiencies when the standard deviation is estimated 
from mean range in groups of v values 


vars = 


n{ser(v)} niser(v)} 


2.6.7 Use of the range estimate sp 

The range estimate is very useful as a rapid check on a more 
accurate estimate. Also, it is.widely used in industrial testing 
and sampling procedures because it can be calculated so easily. 
But its validity depends on the deviations following a normal 
law, and its efficiency is rather low. 
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2.6.8 Example 

The standard deviations of the observations A, and 0, in Example 1.4.2 
are calculated by the three methods in Table 2.6.8. In each case the agree- 
ment between the different estimates is good, the differences being less 
than the estimated standard deviation of s. 


TABLE 2.6.8 
Estimation of o by different methods 


Angle of Prism A 

Xo? = 150 8 = .(150/9) = 4-1 
Z|o|= 32 s, = 1-253 x 32/9-5 = 4-2 
w = 13 sp = 13/3-078 = 4:2 


S.D. s = s/J18 =1-0 


Angle of Minimum Deviation 6 
Ze = 487 s = ./(487/9) = 7-4 
E|v|2 54 s, = 1:253x 54/95 = 7-1 
w = 24 en = 24/3-078 = 7-8 


S.D.s %% 18 = 1:7 


2.7 NOTES AND REFERENCES 


(2.1) That the sum of two normal variables z and y follows a normal law 
can be established directly without the use of cumulants by a change of 
variables 
u = z+? v = oz 一 By， 
in the combined frequency function, followed by integration over v. 

(2.4) Approximations to the x? distribution have been discussed by Blom 
(1954). It is suggested that the test using the quantity y’ might be useful 
in undergraduate teaching, since it does not require extensive tables. 

(2.6) The effieiency of s, was derived by Helmert (1876), and was 
rediscovered by Fisher (1920). The present treatment is based on & paper 
by Guest (1951). 

The distribution of s, is treated by Cadwell (1954). 

Pearson (1950) gives some notes on the use of range. The simple deriva- 
tion of (2.6.5,2) given here is due to Cox (1954). 


2.8 TABLES 


TABLE 2.8a 
The normal distribution 


Q = Pr((y— Y)/c> X), single-tail test. 
Q = Pr((Y—y)/o2 X) single-tail test. 
2Q = Pr(|Y —y l/oz X), double-tail test. 


2Q 


0-995 


— 0-99 
—1:31 
— 1:46 
— 1-59 
— 1-69 


— 1:75 
一 1.77 
—1-79 
ー 1-82 


` 0-250 


0-15 
0-25 
0-29 
0-34 
0-38 


0-41 
0-43 
0-44 
0-48 


Factors d, and efficiencies ij in the estimation of standard deviation 


0-990 


— 0-99 
ー 1:27 
— 1-39 
ー 1-49 
— 1-56 


— 1-60 
— 1-62 
— 1-63 
— 1-64 


0-100 


0-64 
0-73 
0-77 
0-80 
0-84 


0-86 
0-87 
0-88 
0-91 


2.8 TABLES 
TABLE 2.8b 


Values of X = 4x3 v at various significance levels Q 


0-975 


— 0-97 
— 1:19 
— 1:27 
— 1:32 
— 1:36 


ー 1-38 
ー 1:38 
— 1:38 
— 1:39 


0:050 


0:96 
1:03 
1:06 
1:09 
1:12 


1:13 
1:14 
1:15 
1-16 


0-950 


— 0:94 
— 1-09 
— 1:14 
—1:17 
—1-18 


—1-18 
— 1:18 
ー 1:17 
— 1-16 


0-025 


1:24 
1:30 
1:33 
1:35 
1:36 


1:37 
1:38 
1:38 
1:39 


TABLE 2.8c 


from the range 


0-900 


— 0-87 
— 0-96 
— 0-97 
— 0-97 
— 0-96 


— 0-94. 
— 0-93 
— 0-93 
— 0-01 


0-010 


1:58 
1:62 
1:64 
1-65 
1-66 


1-66 
1:66 
1:65 
1-64 


0-750 


— 0:68 
— 0-66 
— 0-63 
— 0-60 
— 0:57 


— 0:54 
— 0-52 
— 0-51 
— 0-48 


0-005 


1:81 
1:84 
1:85 
1:86 
1:86 


1:85 
1:85 
1:84 
1:82 


0:500 


— 0-33 
— 0-24 
— 0-19 
— 0:15 
— 0-11 


— 0-07 
— 0-05 
— 0-04 
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CHAPTER 3 


SOME STATISTICAL TESTS 


3.1 DISTRIBUTIONS OF F AND : 


3.1.1 Beta functions 
The beta function B(p, q) is defined by the equation 


1 
2 の = | 273 1 - ah ds. (12) 
0 
If cos*@ is substituted for z, this is equivalent to the equation 
7/2 
B(p,q) = 2f cos22—1 0 sin2q—1 0 dé. (15) 
[ 0 


The beta functions are related to the gamma functions by 
means of the equation 


_ I(p)T'(g) 
B(p,q) = T(p*g) (2) 


The proof of this equation is as follows. From (2.1,2), 
oo oo 
T(p)T(g) = 4 Í a3 9-2" dz f ya- ev dy. 
0 0 


On changing to polar coordinates z =rcos6, y = rsin6, this 
becomes 


7/2 
T(p) P) = 4ſt osimaae9 
0 0 


= Tío +q) BU. q), 
and so (2) is established. 
From (1a) and (10) it is obvious that 


B( v, 9) = Bq, p). (3) 
The quantity 


B4(p,q) = 2 Í “cos?P-1 0 sin2a—1 0 dé (4) 
0 


is called the incomplete beta function. Tables of this function 
have been prepared by K. Pearson (1934). Table 16 of the 
Biometrika Tables is an inverse table, giving values of « corre- 
sponding to selected values of B. 
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3.1.2 Distribution of F 


If x, and x, are two independent variables distributed as x, 
then 


G P(xi, xa) = C ek" omir yp ye dy, ds. (1) 
The quantity F is defined as the ratio 
xil 
xii 2 
X&l va (2) 
Then Xi = (Pvilvg)* xs. 


To find the distribution of F, the variables in equation (1) are 
changed to F, xa. Now when x, is constant, 


dy, = 20 ½⁰ͤ 2) P y, dF, 
and so (1) becomes 


dP(T', xs) = C ect Gk Fn) yatni dy, Fru dF. 
The variable x, can be removed by the substitution 
x° = xi. Fa). 
Since x? is distributed ‘as y?’ it can be integrated out, leaving 
d (F) = (ITF, 3o» Fh IF. (3) 


This gives the distribution of F. The constant may be evalu- 
ated by making the substitution 


了 /vs = tan?0. 


Then 
7/2 
f dP(F)=1 -of 2(v,/v,)*” cos" 0 sin^-1 0 q0, 
0 
and C = (vilvg)i] (Av, $73). (4) 
Equation (3) then becomes 
1/20 A0 e pin-i 
dP(F)- Bü», 1») p5" + F/] Y 30 F dF. (5) 


The distribution function P(F) can be expressed in terms of 
the incomplete beta function. Thus substitution of Fy,/v, = tan2a 
in (5) leads to 

P(F) = B,(42, 21) I (6) 
B(3o; 3v1) 
Hence numerical values of P(F) can be found from tables of the 
incomplete beta function. 


More convenient in practice are tables of F for given significance 
levels P. Table 18 of the Biometrika Tables gives the values of F 
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for seven values of Q = 1— P from 0:25 to 0:001. Table V of 
Fisher and Yates’ Tables gives the values of e? = for five 
values of Q in the same range. Similar tables are given in the 
Handbook of Chemistry and Physics. 

The quantity 
, Xv — xol pm-1 (7) 


BEC IT (F/ 1/4) 
is more complicated to evaluate than F, but varies much less 
with v, and v,. Table 3.9a gives the values of F’ for Q = 0-05 
and 0-01. 

In all F tables the heading v, refers to the estimate of higher 
X/ v. That is, the subscript 1 denotes the variable for which 


xi x, T 1. 
The levels are for single-tail tests, appropriate to testing whether 
xilw is significantly greater than x2/v, If it is required to test 
whether the two quantities are significantly different, irrespective 
of which is the larger, then a double-tail test is required and the 
values of F given in the tables correspond to significance levels 2Q. 


3.1.3 Distribution of t 
If the variable xi has v, = 1, so that y, = | X|, where X is the 
standardized normal variable, then the distribution of 


F = X*/(x?/v) 


š 1 
1S dP(F) «Bis pU t Tem Pay, (1) 
Hence the distribution of 
X 
t= x (2) 
is given by d P(t) 4dP(\t|) = 3d P(F1), 
or, using (1), 
1 

dP(t) = AN. J (1 + ¢2/v)-#O+) t. (3a) 

When the beta function is expanded this becomes 
IUD a aye 
dP(t) = Ne + Ó[y)-3 o0 dt. (35) 


The ratio # is often referred to as Student's ratio. The range of 
fis from 十 co to —oo. For large v, (1--12|y)-*D tends to e, 
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as may be verified by writing out the binomial expansion. Thus 
the distribution of t approaches that of the standardized normal 
variable X. For small values of v the probability of a large 
deviation is somewhat greater than in the normal case. 

As with the normal curve, it is possible to use either & single- 
tail or double-tail test. Table 3.90 is a short table of values t for 
various significance levels Q(t) and various values of v. More 
extended tables are given in the Biometrika Tables (Table 12), 
and also by Fisher and Yates (Table III, double-tail test). 


3.1.4 t-test for linear function of the observed, values 

If z is a linear function of the observations, Z the ‘true’ value 
of this function, and s(z) the estimated standard deviation of z 
based on an estimate s? = Xw,v?/v of o, then, provided the 
distributions of s and z are independent, the ratio 


2—Z 
BEC w 
is distributed as t with v d.f. 
For if 2 一 Zà; Yis 
the estimate s(z) is given by 
82(z) = (ZAZ/w;) e = (8?/0?) o°(z), (2) 
while Lot v/o = x? = vs2|o2. (3) 


Hence (1) can be written 


showing that the ratio (1) is distributed as t with v d.f. 


3.2 CHOICE OF SIGNIFICANCE LEVEL 


In applying statistical tests to observed quantities, it is necessary 
to decide upon the significance level to be employed. If the 
discrepancy between the observed and expected values is not 
regarded as significant unless the probability of the occurrence 
of a discrepancy at least as ‘bad’ is less than Q, then Q is referred 
to as the significance level. The significance level effectively fixes 
the maximum acceptable discrepancy. 

It is obvious that any discrepancy, however large, is possible 
even when the hypothesis about the magnitude of the quantity is 
true. Thus when Q is taken as 0:05 and the hypothetical value is 
correct, once in twenty observations (on the average) a larger 
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discrepancy than that regarded as acceptable will occur, and the 
hypothesis will be wrongly rejected. The rejection of a true 
hypothesis is referred to as an error of the first kind. The chance 
of making an error of the first kind—of falsely deducing a devia- 
tion from the hypothetical conditions—is just the significance 
level Q. 

Clearly the smaller the chosen value Q, the smaller will be the 
risk of making an error of the first kind. But the risk of missing 
a real deviation from the hypothetical conditions will be increased 
as Q is decreased. An error of this type is referred to as an error 
of the second kind. If Q is to be kept very small, the risk of 
making an error of the second kind can usually only be reduced 
by increasing the accuracy of the experimental value; for example, 
by taking further observations. Thus the standard deviation of 
the mean decreases as n~t, and the spread ターT for a given Q is 
correspondingly reduced. Smaller and smaller discrepancies 
between the postulated value Y and the observed value will 
then become detectable. This is illustrated by Example 3.3.1. 

The choice of the significance level Q is then something of a 
compromise, depending mainly on the consequences of making 
a wrong decision and on the ease with which further measure- 
ments can be made. Values of 0-05 and 0-01 are typical in the 
statistical literature. 


3.2.1 Confidence intervals 
It is often possible to find confidence intervals for the popula- 
tion mean; that is, to find values Y, and Y, such that 


Pr (Y, > Y >F} = o, (1) 


where Y, and Y, are specific functions of the value z, obtained in 
the experiment. The meaning of (1) is that, if the experiment 
were repeated a large number of times, the statement Y, > Y >Y, 
would be true in a fraction « of the experiments. Y, and Y,, being 
functions of %, would of course vary from one experiment to 
the next. 

In particular, if the form of the distribution law depends only 
on the deviations y — Y and not on the actual value of Y, so that 


Pr(y, — Y >m} = Q1(; 4- Y | Y), (2) 
then Pr {1 Sto — Y <n} = Q, —Q> = a, 
or Pr (% -m> Y 206 = o. (3) 


1 and n, are the values of y — Y corresponding to the levels Q, 
and Q,. Hence confidence limits for Y can be found. 
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For the normal law 
X = (y — Y)lo, 
if X, and X, are the values corresponding to the levels Q, and Q,, 
then 7, and Y are oX, and oX,, and so 
Pr {Yo — 0X, > Y 2yo—oX,) = o. (4) 


There will be no unique confidence interval but an infinity of 
intervals for a given a, corresponding to all possible combinations 
of Q, and Q, whose difference is x. As an example, from Table 2.8a, 


Pr (X >1:64) = 0-05, Pr(X > — 1-64} = 0-95, 
and so Yo + 1-640 > Y 2 %- 1-640 (5) 
is a, 90% confidence interval for Y. Similarly, 
Pr {X > 1-96} = 0-025, Pr [X > - 1-44} = 0-925, 

and Yo + 1-440> Y>y,—1-960 (6) 
is also a 90% confidence interval for Y. The confidence interval 
usually given is the smallest of all the intervals at the particular 
significance level. For the normal case the smallest interval is 


the one symmetrical about X = 0. 
For the ¢ distribution 


t = (y— Y)/s(y), 
the values of 7, and n, are t s(y) and t,s(y), where t, and 加 are 
the values of ¢ corresponding to the levels Q, and Q,. Hence 
9 ti S9 > Y 2yo—tss(y) (7) 


is a confidence interval for Y at significance level Q, — Q,. 


3.2.2 Fiducial intervals 

If y, is the value given by the experiment, then it is possible 
to define for a given significance level « à quantity Y, such that, 
if the population mean were Yj, 


PG Y) = o. 


Clearly, if « is close to unity, then it is very probable that the 
true value is less than Y,. This leads to the consideration of a 
distribution of hypothetical values of Y, called the fiducial 
distribution. The fiducial distribution function P,(Y|y) is 
defined by the equation 


Pe(Y % = 1— PC Y). (1) 
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The associated frequency function will be 


d 
fel lj) = ZP Ps(Y Ay PW] Y) 


- | zea! Y) dy, 
dfg(Y|y) _ _ df(yol Y) (2) 


dy, —— dY 
In cases where f(y|Y ) is a function of the deviations y — Y, as 
happens with the normal and £ distributions, the two frequency 
functions are equal. 

If Y, and Y, are the two values for which 


and so 


Pj(Y,| yo) = 1— P(y9| Y») = 1—o4 (3a) 
and ya Yo) = 1— Ply! Ya) = 1 一 oo (3b) 
then FH yo) FAZ = oy a = の (3c) 


and Y,> Y >Y, is said to be a fiducial interval for Y at the 
significance level x. Thus for the normal variable 


Pp(Yo + 1:640| Yo) = 1— P(yo| Y = yo + 1-640) = 0-95 
and Pelya— 1-640 | %) = 0-05, 
and so Yo + 1-640 > Y py, - 1-640 


is a 90% fiducial interval for Y. 

This interval coincides with the confidence interval (3.2.1,5). 
It will now be shown that a fiducial interval is always a confidence 
interval, in the sense that if the experiment were repeated a 
large number of times the population mean would lie within the 
fiducial interval in a fraction « of the experiments. For if Y is 
the true value, there are two values y, and y, such that 


P(y,|¥) =a, PONT) = os, (4a) 
while from (3) 

了 (yo 五) = o, P Yo) = os. (4b) 
Thus, on comparing (42) and (4b), Y, 2 Y when %% >y, and Y >Y, 
when ½ y,, and so Y, > Y >Y, when y,>y,>y,. Now from (4a) 


Pr(y;2 Yo >Y} = aa 一 oa = o, 
and so Pr (Jas Y >Y,) = a. (5) 


The reason for the introduction of fiducial probability is that 
by its use a fiducial frequency function can be determined for a 
quantity containing several variables by assuming that the 
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ordinary laws of probability hold for fiducial probabilities. The 
standard example is the Behrens' test for the comparison of two 
means (Kendall, Vol. II, p. 91; Barnard, 1950). 

3.8 TESTING THE MEAN 
For the mean, the estimated standard deviation is 

&(g) = MN = (Zw,v/(n — 1) wy, 
and the distributions of 7 and s(g) are independent. So, by § 3.1.4, 
g— Y 
t= — 1 
sg) * 
is distributed as with v = n—1 d.f. 


3.3.1 Example 

In Example 1.4.2 the estimated prism angle is 60° 27-0' 1-3, the 
standard deviation being based on 9 d.f. It is believed that the prism has 
been ground to an angle of 60? 25'. Does the experimental value cast doubt 
on this hypothesis ? 

If Y is 60° 25’, t is 2-0/1-3 = 1:5, with 9 d.f. Then from Table 3.95 20 
is 0-17, and hence if the true value were 60? 25' & deviation (in either 
sense) at least as large as this would be obtained in 17% of such experiments. 
Hence there is little evidence that the true value differs from the supposed 
value 60° 25’. 

The question can be settled by taking a larger number of individual 
measurements. If the set is extended to 40 observations, the standard 
deviation of the mean, being proportional to n~t, is approximately halved. 
If the estimate now obtained is 60° 26-8’ + 0:7’, then £ is 1:8/0-7 = 2-6, with 
39 d.f. The value 2Q is now only 0-01, and it is very unlikely that the 
population mean is 60? 25'. It is very probable that there is something 
wrong, either with the original grinding procedure or with the apparatus 
for measuring the angle. 

If the acceptance level had been arbitrarily set at 0-05, then with 10 
observations the hypothesis that the true angle was 60? 25' would have 
been accepted, and an error of the second kind made. Increasing the 
number of observations to 40 increases the ‘resolving power’ of the 
experiment, and shows that the hypothesis is false. 


3.3.2 Confidence interval 
For the 90% confidence interval, based on the measurement 
60? 27' + 1-3’, the values fi = — 1-9 and tz = +1:9 (corresponding 
to Q = 0-95 and 0-05 with 9 d.f.) may be used. Then the values ts 
are + 1-9x 1-3 = + 2-5, and from (3.2.1,7) the confidence interval is 
60° 24-5’ < Y < 60° 29-5’. 
The corresponding interval based on the measurement 
60° 26-8“ 4 0-07’ is 60° 25-6’< Y < 60° 28-0’. 


56 SINGLE VARIABLES 
34 COMPARISON OF TWO MEANS 


Suppose that a set of n, observations leads to the mean g, + (Ji), 
. 8?(],) = Ewy vi;[n 1. 
If a second set of n, observations is made, leading to the mean 
Ta + (J:), the question arises as to whether the two means are in 
agreement. A t-test can be made to verify the hypothesis that 
the two sets of observations came from the same population with 
parameters Y = Y, = Y, and c = 01 = . 

If the hypothesis is true, 7, — Ja is normally distributed about 
zero with variance o?(nj!-- nç1), and 


is the standardized normal variate. Also Lui, vi / and Ew / 
are each distributed as x2, independently of 7, and g,, and so 


x° = (Lioit vit . Lit et) / = >, X wg for 
7 7 


is distributed as x? with v, + v, d. f. ($ 2.4.4). Hence 


(vy + və) Ny Ny | (1) 


(n4 + N) E > 207 555 


is distributed as £ with v, + v, d. f. In terms of s(9,), s(7;), this is 


£= === um CE 


e (y vg) nne y : 
£08.79) 155 + Mg) 171820) + Nava HED) e 

3.4.1 Example 

Consider the results of two different sets of measurements of prism 
* 1. 60° 27.0“ 1:37, n = 10, v = 9; 

2. 60° 25-2'+ 1-5’, n = 15, v= 14. 
Now Ew, vj, = Ny vy 82 (JI) +o va 8? (Gg) = 152 + 472 = 624, 
à 

and so t= 80885624 = 0:85. 


Since this is well above the 10% point, there is no evidence to suggest that 
the two sets of measurements are discordant. 


3.5 RATIO OF STANDARD DEVIATIONS UNKNOWN 


If the means to be compared are obtained by different experi- 
mental methods, the standard deviations c, and o, will in general 
be different in the two experiments. This will invalidate the 
previous discussion, which assumed a single value c. If the ratio 


0 = ojlo (1) 
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is known, then it is easy to show as in $3.4 that 


; 
12 19 | (vy ys) ny na | 2 
1—9) (n4 + Ong) {0-1 ny v, (JI) + Na va 5*(95)) (2) 
is distributed as t with vı v d.f. However, the ratio 0 is seldom 
known. 
For cases where c, and c, cannot be assumed equal, Welch has 
introduced the variable 


t. A = 71 — 72 
Sm 62071) T 52(g,)) 
-- UM » 72 3) 
(220; v$;[n4 v4 + wy v$;[ns v) 


the denominator being simply the estimated standard deviation 
of the difference 7,—9,. t, will not be distributed exactly as ¢. 
However, it can be shown ($ 3.5.2) by comparing moments that 
tn is distributed approximately as t with 
_ (ni! nj!) 
62. vz + nz? vg? 


(4) 


degrees of freedom, @ being the ratio of the variances. Of course, 
this ratio is not known—if it were, the test using (2) could be 
employed. But it appears in practice that 0 can vary within 
wide limits without affecting the value of t sufficiently to invalidate 
the test. The simplest choice for the value @ is the ratio of the 
estimated variances, 


0 = (vi! Ew v?;)/(vz? Dw, v). (5) 

Then if s,,; and Smg are the estimated standard deviations of the 

individual means, and sm = (85,1 +82,2)? the standard deviation of 
the difference, (4) becomes 

Sin 

8541/1 + 8h (e 

Accurate values for t, at the 5% and 1% (single-tail) significance 

levels are given in Table 11 of the Biometrika Tables in terms of 
v4, vg, and the ratio s?,,/s?,. 


3.5.1 Example 
'The following two measurements for the angle of a, prism were obtained 
using different experimental methods: 
1. 60° 17-3°+2-4’, n = 10; 2.60? 10-5’+3-5’, n = 20. 
6-8 


m = (556412355 ^ 1°60. 


From (3.5,3), t 
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18-01? 
n ” ^ 5768/0 12.255015 
The value 如 = 1:60 with 28 d. f. corresponds to about the 6% level for a 
single-tail test. So, while the means are not definitely discordant, there 
may still be some doubt about their agreement. 
To use the Biometrika Tables it is necessary to calculate the ratio 
dsi 0 5 5.76 
A1 S TA 2 S Tn 18-01 
With v, = 8,v, = 20, ratio 0:32, v t is 1-70 at the 5% confidence level. 
Hence the value £,, = 1:60 is just above the 5% level, agreeing with the 
result obtained using the approximate distribution. 


= 28-0. 


= 0:32. 


3.5.2 Approximate distribution of tn 
The value of t,, is "n 
t. = 21 — 72 Om (1) 
Om Sm 

where om and s, are the standard deviation and estimated 
standard deviation of the difference 7,— $3, If this is to be 
distributed approximately as t, it must be of the form Xv*/y, and 
so y82/o2 must be distributed approximately as x? with v df. 


But the actual value of this expression is 


2 2 2 ° 2 
xi vs% v | o? (= 0 02 | 0 (3) 
0 。2 o ; ? "s 
o lnn oj nava 02 


where the terms in round brackets are distributed as y? with 
v, and v d.f. To find v, the moments of each side can be equated. 
For the expectations, since E(x?) is v, 


MEA E _ 
= aleta] =» 


an identity. For the variances, since var x? is 2v, 


2 2 42 242 
2, = は ) ( 21 | 2v; + (2 ) >|, 
Om Ny Vy Tio Vo 


m „ m _ 
7 01/1 v1 + ongv 


Thus if v is given by (3), vs2/o2, is distributed approximately as 
x? with v d.f. The first and second moments of vs2/o2, and x? 
coincide, though the higher moments may diverge. Hence t, is 
distributed approximately as t with v d.f. 


(3) 


3.5.3 Behrens’ test 


It is somewhat easier to find fiducial limits for 571 — 92. The 
theory will not be discussed here (see Kendall, 1948, Vol. II, 
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p. 91). Fisher and Yates (1948) tabulate fiducial (double-tail) 
limits for 


a= -Zl 
V (83,1 + 52,3) a) 
in terms of vi, və and 0, where 
tan の = Sil Smy- (2) 


The test using these quantities is known as Behrens' test. 


3.5.4 Example 
For the example of $ 3.5.1, 
24 
の = tan 135 = 34% v = 9, ws = 19. 


From the tables, for v, = 8,v, = 24,0 = 30° the variable d is 2-12 at the 
5% fiducial level. Thus the significance level corresponding to the observed 
wes d = 6-8//18-01 = 1-60 

is certainly greater than 5% (double-tail test). 


3.6 EXAMPLE OF THE USE OF THE F DISTRIBUTION 
TO COMPARE VARIANCES 


One observer, in measuring an angle to the nearest minute, 
obtains a value Xv? = 27.3 based on 10 observations. A second 
observer obtains a value Xv = 12-1 based on 15 observations. 
Is there sufficient evidence to indicate that the second observer 
is the more reliable 2 

Now Xv?/o? is distributed as x2 with v — »—1d.f. If it is 
assumed that the two observers are equally reliable, so that c is 
the same in each case, 


F = GN, = vs LU,, Xv$ 
= 14 x 27-3/9 x 12-1 = 3-51, 
with x, = 9, v, = 14. From the tables, F is 3-21 at the 2.5% level 
and 4-03 at the 1% level. Hence on the hypothesis that the two 
observers are equally reliable such a high value of F would only 
have been found in 2% of such cases. So it is very probable 
that the second observer is more accurate than the first. 
For the variable F’ defined by (3.1.2,7), 
F. = (J(14 x 27-3) — (9 x 12-1) (27:3 + 12-1) 
— (19-5 — 10-4)/6-3 — 1-45. 

From Table 3.9a, the value of Z” for v, = v, = 12 at the 5% level 
is 1-15 and at the 1% level 1-59. Hence the observed value of F” 
corresponds to the 2% level. 
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3.6.1 F test for homogeneity 

The n observations % with mean 97, may fall naturally into 
r separate groups, containing n; observations, with means jj, 
where nj = En; 9 (1) 
For example, the groups may represent the readings taken on 
different days. It may be desired to test whether the whole set 
is homogeneous—whether all the observations can be regarded as 
having been taken under the same conditions. That is, whether 
all the y; can be regarded as coming from a single normal popula- 
tion with mean Y and standard deviation o. 

If y;; denotes an observation in the jth group, 


Z(y,— Y)? 0 = Y C. - -e Y)}?/o?. 


On expanding the right-hand side, using the properties of the 
means, 


Z(y,— Theſon = ZXvho*- Zm (g, Me or ng Y}*/o%. (2) 


Now, from $ 2.5.2, each term on the right is distributed as x? 
independently of the others. The degrees of freedom of the terms 
of (2) are n, Z(n;—1) n x, r—1, and 1. Thus if the whole set 
is homogeneous, the ratio 

Toe (n -T)? (3) 
Tu, (J -r) 
will be distributed as F with (n —r,r — 1) degrees of freedom. 

If the observations are of different weight, Xv}, is replaced 

in (3) by 220; vj; and n; by X Wj 
i 


3.6.2 Example 

The values y;, in Table 3.6.2 represent readings of refractive index of 
air (referred to a convenient origin and scale) obtained on five different 
days. The observations are combined to give the means for each day g; and 
the grand mean j. 

The residuals v, = y;;—g; have been separately evaluated in order to 
calculate Lug. By a method similar to that used in establishing (3.6.1,2) it 
is easy to show that 

Eyj = Xvj +n; J (1a) 
and D. = Df. + Un, (g, He + ng. (15) 


These relations provide a very satisfactory check on the arithmetical 
calculations. 
The F-test for homogeneity gives 
488 [4064 


Y | = 103 m = 4, = 34), 
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showing that there is no reason to suspect day-to-day changes in the 
instrument or in the composition of the air. 

Statistical workers often rewrite (15) as an analysis of variance table, in 
the form shown in Table 3.6.26. From (3.6.1,2), the two middle mean 
squares are estimates of the variance o*. The other two mean squares 
would also be estimates of c? if Y were zero. 


TABLE 3.6.2 


Observations of refractive index on different days (Example 3.6.2) 


Day j 1 2 3 4 5 SUM 
Observa- 38 53 30 36 27 53 16 48 38 18 
tions 07 22 42 38 34 34 31 24 | 47 20 
Vu 31 37 32 37 39 50 | 40 15 21 31 
46 33 46 24 29 30 
40 46 39 
Number n; 10 8 6 9 6 39 
Eys 353 285 237 272 175 1322 
d; 35-30 35:62 39-50 30-22 29-17 g 33-90 
7;—9 十 1.40 | -172]| +560 | 一 3.68 | —4-73 | En;(9,— 9) 
— 14 
Ly}; 14037 | 10489 | 9871 9184 5779 49360 
n; jj 12461 10153 9362 8220 5104 45300 
Xv}, 1577 337 511 964 675 4064 
CHECK SUM 49364 
En, (J. Y) 488 
ng? 44812 
CHECK SUM 45300 


TABLE 3.6.2a 
Analysis of variance table for Example 3.6.2 


Estimated 


Deviations variance 


Of grand mean from 
zero 


Of each mean from | En; (g, — #)° 
grand mean 


Of observations from | D vs. 
each mean 


Of observations from | Z2j, 
zero 
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3.7 THE REJECTION OF OUTLYING 
OBSERVATIONS 


A number of tables have been devised giving the probability, 
assuming a normal frequency distribution, of obtaining large 
deviations from the true value and from the mean. These tables 
may be used to test whether there is something unusual about à 
particular observation, and hence whether it should be omitted 
from the series. 

There is à very real danger of introducing bias by rejecting an 
outlying observation. The occurrence of such observations may 
in fact be an indication that the observations do not follow a 
normal law, and it is then obviously incorrect to apply tests 
based on the normal law. Most scientists would feel that it is 
wrong to reject an observation merely because it lies a long way 
from the mean. Certainly the decision to apply such a test 
should be made before the observations are taken, and not after- 
wards in an effort to improve the accuracy. The occurrence of 
outlying observations is an indication that the apparatus is not 
as well under control as had been hoped. Of course, it is perfectly 
legitimate to reject observations in which an obvious copying or 
reading error has been made. 

The question of the rejection of outlying observations has been 
discussed by Jeffreys (pp. 188, 280, 287), Brunt (p. 129), and 
Wilson (p. 256), among others. It is only when the number of 
observations % is small that the question is of importance. When 
n is small the rejection of an observation may produce a large 
change in the estimate of mean and standard deviation, while 
when 7 is large the effect of any single observation is much less. 

The tables designed for the testing of an outlying observation y, 
are listed below. 

(a) Population mean and standard deviation known : Biometrika 

Tables, Table 24. Upper and lower percentage points of 
[yo — Y ||o at 10, 5, 2-5, 1, 0-5, and 0-1 per cent confidence 
levels; » — 1(1)30. 


(b) Population standard deviation known: Biometrika Tables, 
Table 25. Percentage points of (yo —)/o; n = 3(1)9. 
(c) Estimate of standard deviation s, based on vd.f., inde- 


pendent of the set being tested: Biometrika Tables, Table 26. 
Five and one percentage points of (y,)—9)/s,; n = 3(1)9; 
v from 10 to co at irregular intervals. Due to Nair, and 
extended by him (Nair, 1952) to include 10, 2-5, 0-5, and 
0-1 percentage points. 
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(d) Estimate of standard deviation s from set being tested: 
Grubbs (1950). 10, 5, 2-5, and 1 percentage points of 
(yo — )/8; n = 3(1)26. 

(e) Test based on range: Dixon (1950, 1951). Tables of 


= ュー 21 
- * 


where z, is the suspected observation. 
An account of (c) and (e), with examples, is given by Proschan 
(1953). 


3.8 NOTES AND REFERENCES 


(3.1) Student was the pen-name of W. S. Gosset, & chemist who made 
substantial contributions to statistics. He discovered the distribution of 
tin 1908. ‘Studentized’ is an accepted adjective in statistical literature for 
describing & quantity whose distribution is independent of the scale para- 
meter c (Kendall, 1948, II, p. 80). 

Lord (1947, 1950) discusses the use of range in place of standard devia- 
tion in a t-test. See also Biometrika Tables, Section 14. 

Nekrassoff (1930) gives a nomogram for the t-test, while Crow (1945) 
gives a chart of x? and t distributions. 

(3.2) The theory of statistical estimation is only treated very briefly. 
The discussion of confidence and fiducial intervals follows Kendall (1948, 
II, Chs 19 and 20). Some writers do not distinguish clearly between the two 
intervals. The theory of estimation as developed by Neyman and Pearson 
requires the specification of alternative hypotheses to that under test, and 
is described in Ch. 26 of Kendall's book. A non-mathematical account is 
given by Wilson (1952, Ch. 8). 

(3.5) A straightforward account of the combination of means with 
different variances is given by Cochran (1954a). References on Welch's 
method and related topies are: Aspin (1949), Welch (1937, 1947, 1951), 
Trickett and Welch (1954), Uttam Chand (1950), James (1951, 1954), and 
Meier (1953). 

Bartlett (1937) amd Hartley (1950) give tests for heterogeneity of 
variances. See also Biometrika Tables, Section 16. 

(3.6) The effect of unequal group variances on the F-test for homogeneity 
of group means is discussed by Horsnell (1953). 
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3.9 TABLES 
TABLE 3.9g 
Values of F. = (x, vk —x2%4)/(x2 + x3) for significance levels Q = 0:05 
(upper figure) amd Q = 0:01 (lower figure). v, is d.f. of variable 
of greater x*|v. Values of Q for single-tail test; for double-tail test 
levels are 2Q = 0:10 and 0-02 


» 1 2 3 6 12 24 co 


12 1-00 1:07 1-10 1-13 1:15 1:17 1:18 


24 0-98 1:05 1-09 1:12 1:14 1-16 1:17 


TABLE 3.9b 


Values of t = X|yv> = (z—Z)/s(z) for various significance levels Q. 

Q(t) is the probability of obtaining a value greater than t (single-tail 

test). Q(t) is also the probability of obtaining a value less than —t. 

2Q(t) is the probability of obtaining a value greater in magnitude 
than t, irrespective of sign (double-tail test) 


Q 01 0-05 0025 00 0-005 0.0025 0-001 0-0005 
2Q 02 01 0-05 0.02 0:01 0-005 0.002 0-001 
v 
1 91 63 127 31-8 63.7 127 318 637 
2 19 2.9 43 7-0 9-9 14-1 22-3 31-6 
3 16 2-4 3:2 4:5 5:8 75 10-2 12-9 
5 15 2-0 2-6 3:4 4:0 48 5-9 6-9 
8 14 1-9 2.8 2-9 3-4 3:8 45 5:0 

12 14 1:8 2:2 2-7 3:1 3:4 3-9 43 
24 13 17 2:1 2-5 2:8 3:1 39:5 3-7 
oo L3 L6 2-0 2-3 2-6 2-8 3:1 3:3 
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CHAPTER 4 


DISCRETE DISTRIBUTIONS 


The distributions to be discussed in this chapter are those appro- 
priate to counting experiments, where the numbers of events 
falling into specified classes are determined. The values of the 
observed variables are then integral, and the distributions differ 
in certain respects from the continuous distributions discussed in 
earlier chapters. 


431 THE BINOMIAL DISTRIBUTION 


If the probability of an event occurring in a trial or experiment 
is denoted by 2, then the probability of it not occurring is 
q-—1—29. When n trials are made, the probability of the event 
occurring in r of them is 


! 
firm = v piri T (1) 
For r que gives the probability that a particular sub-set of the 
n trials should be successful—for example, p'g^-" is the proba- 
bility that the event occurs in the 2nd, 4th, 6th, ..., 2rth trials 
and not in the others. The numerical factor ("C,) takes account 
of the fact that the order of the successful trials is immaterial. 
The frequency distribution (1) is called the binomial distribution. 

The characteristic function can be defined in a similar way to 
the definition for the continuous distribution, the integral being 
replaced by a sum. Thus 


5% = È orifi) = Xe rn. 
and so の (の = (pet + q)". (2) 
The cumulative function is 
p(t) = log (t) = nlog (1--p(et— 1)). (3) 


The cumulants are found by expanding this as a logarithmic 
series and collecting powers of (it) /j!. The first four cumulants are 


(4) 


Ki = NP, 4 = "pq, | 
cs = mpq(1 — 2p), 4 = mpq(1 — 6pq). 
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The variance of r is npg. For the standardized variable 
デー (5a) 
(npa) ' 
the cumulants will be, from (1.7.3,6), the values (4) divided by 
(npq)?. Hence for the variable &, 
Ky = l, ks = (npg)3(l—2p) 4 = (mpg)*(1—6pq), (5b) 


and, provided npq is not too small, the higher cumulants will 


be small. 
. The intervals AZ between neighbouring values of Z are given 


by Ar = 1, and so AR = (npg). (6) 


As n becomes larger, the discontinuous distribution of values 
F. S) approaches more and more nearly to a continuous distribu- 
tion whose frequency function is %), where the probabilities of 
a value lying in the range AZ about & are equal in the two cases, 

L(A) AB = /(@). (7) 


Now the characteristic functions 
Í . e d and LH) ei 


will be very nearly equal for the two frequency functions, and so 
will be the cumulants. Hence, from (55), f() will be approxi- 
mately normally distributed if npg is large, 


AG) +J e 
Thus from (6) and (7), 
fa Tape) eit (8a) 
and flr) Je e—ie—npy'mpq, (8b) 


Provided npg is not very small, the frequency function f(r) will 
approximate closely to a continuous function of the normal form 
with mean np and variance npq. 


42 THE TESTING OF HYPOTHESES BY THE x° TEST 


Suppose that the range of the observations is divided up into 
m groups, and the hypothesis predicts the numbers R, of the 
observations which should fall into the ith group. The predicted 
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number R, equals Ny, where N is the predicted total number 
and p; the predicted fraction in the ith group. The distribution 
of the observed number r; is of the normal form (4.1,8b), 


Feri) c exp [ A-.) Nx, q), (1) 
and so (r; R.) NY, g, will be distributed as x2 with 1 d.f. Hence 
2_ m (r— R,)? 

im. Riti (2) 


will be distributed as x? with m d.f. If m is fairly large, g will be 
quite close to unity, and in practical tests the form 


E x = ( Ag) 
* IR 3) 
is more usually employed. 

When x° has been calculated, the significance level Q(x2) can 
be found and a decision made as to whether the divergence of the 
r; from the R, is reasonable or not. 

The form (1) is valid only if Ny, g. Vp. R; is fairly large, 
since the higher order cumulants are negligible and the distribu- 
tion of +; approximates to the normal form only if this is so. 
The groups must be chosen so that none of the expected values E; 
is very small. Five is often suggested as the minimum allowable 
value for R.. 


4.2.1 Degrees of freedom 


Often the value -N of the predicted total number of observa- 
tions is not known, but must be estimated from the observed 
number n. Then the R, are not known, and only the values 


Ë, = 2p; 
are available. Since Er, = >Ë, =n, 
> (r, — R.) 2/ R. = Ar, —f,)?/R, + x(n — NY p3/R;. 


It follows, as in $ 2.5.2, that (r. R.) 2/ R. wil be distributed 
as x? with (m—1)d.f. Hence 


m m 
ZU / R. = と np. (1) 
will be distributed approximately as x? with m — 1 d.f. One degree 
of freedom is lost because the values Ë, are not independent, 
but ZÉ,—mn. ` 

More generally, it may be assumed that each adjustable para- 
meter (such as N) in the distribution law which must be estimated 
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from the data reduces the degrees of freedom by unity. Thus 


y n R,)/R; (2) 
i=1 


may be assumed to be distributed approximately as x? with 
m — q d.f., if q parameters obtained from the data are used in 
calculating the predicted values K.. 

Since the proof of this statement depends on the parameters 
being chosen to minimize 


x? = Tr. R.) / R., (3) 


it is strictly only true when the parameters are in fact chosen in 
this way. A short outline of the proof will now be given. 
Suppose the R, are functions of q parameters B,, 


R; = z,(B;). 
Then if the estimate of B; is b;, the estimate of R, is 


q 


Od, 
Tij = B, 


If the values b; are chosen to minimize (3), 


where 


Ê 
Zir- RG /R. = 0 = Dr.- Ro R. (4) 


and 
X(r,— R,)?/R, = U(r, R.) R. + (b, — B.) /R. (5) 


The two terms on the right-hand side of (5) may be shown to 
be distributed as x?, with m- d.f. and q d.f. respectively. The 
proof is on the same lines as that of $8 2.5.2 and 8.2.1, and will 
not be repeated in full. If the substitution ` 


is made, where the 7;; are orthogonal functions satisfying 
> Ta TND R. = O, 


then the second term in (5) becomes 
1 
> R, (Z(a;- Aj) Tu? = E (a; — A, > Tål Ri 


and (5) is of the same form as (8.2.1,3). 
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4.2.2 Example 


One thousand throws were made with & six-sided die. The number of 
times the various faces came uppermost are recorded in Table 4.2.2. 


TABLE 4.2.2 
Throws with a six-sided die (Example 4.2.2) 


Face No. of times r; x? 

1 173 0-24 
2 194 4-48 
3 152 1-29 
4 165 0-02 
5 181 1-23 
6 135 6-02 

13-28 


On the hypothesis that the die is uniform, p; = 1/6 and Ê, the predicted 
number of times, is 1000/6 = 166 2/3 for all six faces. Hence on this 


hypothesis the values x° = (r, — R p2/R, in the third column are obtained, 
and Xy? = 13-28. Since the total number n is used in estimating Ri, the 
degrees of freedom are 5. The value 
x’ = 4x? —4v = 3-64—2-23 = 1:41, 
and so from Table 2.8b 
Q(x?) = 0-02. 


This is, if the die were uniform, a value of xy? as high as this would be 
obtained once in fifty trials. Hence it is unlikely that the die is uniform. 

Another example of the use of y? in the testing of hypotheses is given 
in $ 4.3.4. 


43 THE POISSON DISTRIBUTION 


4.3.1 The counting of particles 

In many experiments in nuclear physics and cosmic-ray physics, 
it can be assumed that the average rate of arrival of the particles 
is a constant, denoted by the symbol u. Then the probability of 
a particle arriving in a small time interval dt will be pdt. 'The 
form of the frequency function f(r|t,u) giving the probability 
of r events occurring in time ¢ will now be determined. 

If dt is small, the probability of two events occurring in time dt 
will be negligible. Consider the probability of r events occurring 
in time £-- dt. This can come about in one of two different ways; 
either: 

(i) r events occurred in the interval (O, f) and none in the interval 
(t, t+ dt); the probability of this is the product f(r |t, A) x (1 — pdt); or 
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(ii) r—1 events occurred in the interval (O, t) and one in the 
interval (1,1 -- dt); the probability of this is the product 


f(r — It, ) x pdt. 


Since these two alternatives are mutually exclusive, the proba- 
bility f(r|t--dt, u) is the sum of the individual probabilities. Thus 


Ft dt, u) = f(r|t, u) + ud f(r — 16 A) It, A)). 
Dividing by dt, and proceeding to the limit, 
d 
3, tlt) -e, a) t, ). (1) 
The solution of this equation is 
t 
feitu) = ecu ET, (2) 
as may be verified by substituting (2) in (1). 
Since the function depends on the product ut, and not on the 
individual values p and t, 


feriat = 2) = em 和 (3) 


A distribution whose frequency function is of the form (3) is 
called a Poisson distribution. 


4.3.2 Characteristic function 
The characteristic function for the Poisson distribution (written 
¢(z) instead of (t) to avoid confusion with the time variable) is 


$e) = em7eI) = ex EAST, 
and so $(z) = expA(e*—1). (1) 
The cumulative function is 
(z) = A(e*—1), (2) 
and K; = À. (3) 
All the cumulants are equal to À. In particular, 
E(r)=À, varr = A. (4) 


In standard measure, the cumulants of / are x; = 入 -地 +1. 
Hence if À is not too small, the higher cumulants will be un- 
important and the distribution approaches the normal form, in 
the same way as does the binomial distribution. 
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4.3.3 Estimation 


Since the expectation of r is A, it follows that the observed 
number of arrivals + in time t will be an unbiased estimate of À. 


Hence É = rit (1) 


will be an unbiased estimate of the parameter u. The variance 
of this estimate is given by 


var fit = A, 
and so 8 = rt|t (2) 
will provide an estimate of the standard deviation of g. Hence 
ñ = (r + rh)|t. (3) 


4.3.4 Example 


The number of cosmic-ray particles detected by a coincidence telescope 
in an undergraduate laboratory experiment was recorded for a period of 
one hour (Guest and Simmons, 1953). In that time 87 particles were 
detected. Hence the estimate of u, the number arriving per minute, is 

p = (87 + 9-3)/60 = 1:45 + 0-16. 


The mumber of particles occurring in each minute interval was also 
recorded. Table 4.3.4 lists the number of minute intervals in which + 
particles were recorded. 


TABLE 4.3.4 
Number of minutes in which v particles were recorded 


* Observed no. f(r) Predicted no. x? 
0 13 0-235 141 0-09 
1 22 0-340 20-4 0-13 
2 14 0-247 14.8 0-04 
3 T 0-119 7-1 0-00 
4 4 0-043 2-6 
>4 0 0.016 10 9:94 
Sum 0-30 


If the rate of arrival follows & Poisson distribution, # is unity and 


filu 2 X) = eE. 


Hence the predicted frequency function is 


= 1-45) = ents 9L. 1.457/4-263r! 
A= „ / 
and the predicted numbers in the groups are these values multiplied by 
60. The predicted numbers are shown in Table 4.3.4. 
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To test the agreement between the observed and predicted numbers, x? 
is calculated. The categories n = 4,» 4 are grouped together, since the 
expectations in each are small. Since both the parameter u and the 
expected total number are calculated from the data, two d.f. are lost. 
Hence x? is 0-30 with 3 d.f. (y’ is — 1:18), and OG, the probability of 
obtaining a higher value of x?, is 0-96. 

The agreement between the observed and predicted frequencies is then 
much better than would normally be expected. The obvious conclusion 
would be that this set of readings has been specially selected as the example 
for the published paper because of the good agreement between the 
frequencies. But in fact this obvious conclusion happens to be untrue. 
The equipment was simply set up and the readings taken over a period of 
an hour. It was not discovered till later that the agreement was 'too 
good’. The temptation to obtain a further set of readings leading to a 
smaller y? was resisted. The experiment has been repeated by a large 
number of students, who have obtained a wide range of values for (x“). 
The conclusion that there is something queer about the published set is in 
fact merely an error of the first kind. 


44 THE POISSON DISTRIBUTION AS THE LIMITING 
FORM OF THE BINOMIAL DISTRIBUTION 


The binomial distribution for rare events, with p very small 
and % sufficiently large so that np is finite, approximates to the 
Poisson form. For, using Stirling's approximation to the factorial, 


nl (20)! une 


(%ー7)1 (nr (n == eni 一 n'(1— /n ee, 


and so (4. I, 1) becomes 


fel) = (1-2) erp py 


* mE (1 -»vl( - — [t -)a ー タ | à; 


Now ( 工 一 0) = (2 %) en, 0 -9 ze, 


and since p~r/n is small the last term in square brackets will be 


close to unity. Thus 
fr |n) > PRE one, 


and in the limit as p—0, noo, the binomial distribution 
approaches the Poisson form with A = np. 
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4.5 SIGNIFICANCE LEVELS FOR THE POISSON 
DISTRIBUTION 


The significance levels for the Poisson distribution can be found 
from the levels of a related x? distribution. From (2.4,4), if v = 2m, 


1 X 
P(x*|m) = 2m(m — 1)! li eà (s3)m1 dt. 


Integrating this by parts, 


P(x2\m) = Pul IE (22) „ + J, eurer dr.]. 


or P(x?|m) = = +P(x?|m+1). 


It follows that 
lI ur ai 


R> m 


P(x? |m) = (1) 


For the Poisson distribution, the — of obtaining a 
value greater than or equal to 7, 


Q(r|A) = 1— P(r—112), (2) 
is from (4.3.1,3) Q(r|A) = b pe^ (3) 


Hence, comparing (1) and (3), 
Q(r|A) = P(x? = 2A|v = 27). (4) 

It wil be noted that, as the Poisson distribution is discrete, 
there is a finite probability of the value ヶ occurring, and the 
relation Q(y) = 1 — P(y) for the continuous distribution is replaced 
by the relation (2). 

The probability of obtaining a value less than or equal to r is 

P(r|À) = 1—Q(r-1|A) = 1— P(x? = 2A|v = 2r + 2), 

and so P(r|A) = Q(x? = 2A|v = 2r + 2). (5) 

Hence the upper and lower limits for + at & given a 
level can be found from the corresponding limits for the x? 
distribution. 


4.5.1 Tables of Poisson limits 
Table 40 of the Biometrika Tables gives as functions of r the 
values A, and A, for which 


Pr ui) =a, の (7|As) = w. (1) 
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The values À, and A, are given for five significance levels from 
0-05 to 0-001, and for values of r 0(1)30(5)50. 

The values À, and A, defined by (1) correspond to confidence 
limits for the parameter A, as in § 3.2.2. For if 7, and r, are the 
two values of r for which 


Peri = a, OA) = %, (2) 
À, is greater than À when r is greater than 21, and A, is less than À 
when r is less than 72. So 
MI ARA when rr ri. 


But, from (2), z, 27 2 r, in a fraction 1 — 2a of a set of observations 
of r. Hence 
Pr (u >À > àp} = 1 20. (3) 
The limits À, and À, can also be found from the square root 
approximation formulae 


Ay = (Jr +1)+ X”), (4a) 

Az = (r-X"P, ` (4b) 

where the values X" are given in Table 4.8a for selected values 
of r. X" varies only slowly with r, and is normally distributed 


with magnitude one-half the standardized normal variate X when 
r is large. 


4.5.2 Example 
An observation with the cosmic-ray telescope yields 28 particles in 
20 minutes. From the Biometrika Tables, A, = 40-5 and A, = 18-6 at the 
5% (double-tail) level. The corresponding limits for u = A/t are 2-02 and 
0-93. 
For the square root approximation, from Table 4.8g, X” = +0-98, and 
À, = (429 + 0-98)? = 40:5; 


Ae = (/28— 0-98)? = 18-6. 


4.5.3 Effect of r being limited to integral values 

In the discussion of $ 4.5.1, it was assumed that values r, and 
rg satisfying (4.5.1,2) could be found. Though this would be true 
for & continuous distribution, it is not true in counting experi- 
ments where the variable is limited to integral values. For such 
cases (4.5.1,2) is replaced by 


Pri = i, Q(r2| A) = Xs; (1) 


where 7, is the smallest integer for which x, < x and r, the largest 
integer for which a,<a. Then, if r»7, P(r|A)>a, while 
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P(r|A,) = <, and so u A. Similarly, if , A, SA. Hence 


A1 AA when vr ri. (2) 
But Pr{r>ry} = Q(rx+1) = 1— P(r) = 1 ai 
and Pr{r >ra} = Q(r,) = os, 
and so from (2) 
Pr (Al >à >À} = l-a - a> l — 2a. (3) 


The true significance level will be greater than the nominal level 
1—2a. However, the difference between the two levels will be 
small unless A is small. 

As an example, if À has the value 15, the expressions 


ア (5|15) = 0-002792, P(6|15) = 0-007631, 
Q(26|15) = 0-006185, 0(27|15) = 0-003312, 


cam be obtained by summing the individual terms of (4.3.1,3), 
which are listed in Table 39 of the Biometrika Tables. Now, from 
Table 40 for 1 — 2x = 0-99, À, is less than 15 when < 5 and A, is 
greater than 15 when >> 27. Hence 


Pr {À >À >À} = 1—P(5|15) 2715) = 0-993896, 
and the true significance level is 0-994 rather than 0:99. 


4.5.4 The sum of two Poisson variables 


The characteristic function for the sum of two Poisson variables 
with parameters À, and A, is, from (1.7.3,2), 


P(t) = Gilt) balt) 
= {exp uit 1)) (exp Ae — 1)} 
= exp (0s A) (et 1). 
The frequency function for the sum will be of the Poisson form, 


Ar 
fir) = e, (1) 
with parameter À = A, +s. 


4.5.5 Comparison of two estimates of a Poisson parameter 


On the hypothesis that two observed values r, and r, came 
from a population following a Poisson distribution with para- 


meter A, Fb = (ei (|n), 
or f(t. Tal À) = fe- (2))r/r!] [r !/2rr;!r,1], (1) 
where r = ri T rz. The first term is f(r|A), from (4.5.4,1). 
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Now the values ri and 7, will occur when the sum is r = 7, +>, 
and one of the values is 11. Hence, using the fundamental theorem 
for the product of probabilities, equation (1.1,3), 


Fru 7913) = fra 7913) frr + ro AÀ). (2) 

Thus, on comparing (1) and (2), f(r,|r,--73) is the second term 
in (1) and " 

ftir ner) = (7)27. (3) 


So the probability, given the sum r, that a value for the smaller 
observation less than or equal to a particular value b will be 
obtained is 


em 总- : 


In the Biometrika Tables, Table 36 gives values of b corre- 
sponding to certain significance levels for values of r in the range 
1(1)80. Hence a test can be made as to whether two values 7r, 
and 7, are consistent. 

The variance of the difference r,—r, will be 2A, and, since 
E(r,--r,) is 2A, r,--r, will be an estimate of the variance of the 
difference. It is found that the expression 


ya 一 和 一 2  r—2(ri--1) 
(rn) c Jr 


is distributed approximately as .X, the standardized normal 
variate. Calculation shows that, when r exceeds 10, the values 
for r, obtained by equating (5) to various values of X are practi- 
cally always the same as those given in the tables (occasionally, 
when the value given by (5) is near a half-integer, it will be 
rounded to the integer above or below that given by the tables). 

It follows that the simple formula (5) provides an adequate 
test for the agreement between two values +, and r, The test 
wil usually be a double-tail test, to determine whether the two 
values are significantly different. As in $ 4.5.3, the fact that the 
distribution of r is discrete makes the true significance level 
somewhat greater than the nominal significance level for small 
values of A. Table 36B of the Biometrika Tables shows the true 
levels for certain nominal levels as functions of A. 


(9) 


4.5.5.1 Example 


In Example 4.3.4, 87 particles were recorded in the hour. In another 
experiment 73 particles were recorded. Are these values discordant ? 
From (4.5.4,5) 


X = (rx ri -2)/ (r, 79) = 12/J160 = 0-95. 
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From Table 2.8a, Pr(|.X|2 0-95) = 0-4. So there is no evidence that the 
two values are discordant. 


4.5.6 F test for estimates of a Poisson parameter 

If r is fixed, it follows from (4.5,4) that 2ut is distributed as y? 
with 2r d.f. Hence if the times t, and 加 to count 7, and r, particles 
are measured, the ratio 


[T _ Éz 

ter: K. a) 
is distributed as F with (27, 2r,) d.f., and the two estimates ji, 
and fz can be tested for agreement. If the times ti and t, are 
fixed and the number of particles +, and +, arriving in these 
times are determined, it can be shown that the ratio (1) will still 
be distributed to a good approximation as F (Cox, 1953). 

For the example of $ 4.5.5.1, 


F = 87/73 = 1-19, 


Vr ts)— (rst). J87— 73 0.85 
V(t, + te) y2 o ' 


4.6 COUNTING LOSSES 


When the interval between two successive events is small the 
counting device may not record the second event. There is 
usually a finite interval following the recording of an event, 
variously referred to as the dead time, paralysis time, recovery 
time, or resolving time, during which the counter is insensitive, 
and any event occurring in that time will not be recorded. In 
such cases the number of events counted will be less than the 
number actually occurring, and it is necessary to apply some 
correction to allow for counting losses. 

In theoretical discussions of counting losses two ideal types of 
counter are considered. In the first, referred to as & Type I 
counter by writers on probability theory (Feller, 1948), and as a 
Type II counter by some physicists (Korff, 1955), the dead time 
has a constant value 7. In the second type (referred to as Type II 
or Type I) the dead time has a constant value 7 provided no new 
event occurs in 7. An event occurring during the dead time is 
not recorded, but it extends the dead time by an amount 7 from 
the instant at which it occurred, and the counter only returns 
to a sensitive condition when there is an interval of length + 
during which no new event occurs. Such a counter may be 
described as having an extended resolving time. A Geiger 


or F’ = 
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counter approximates to an ideal counter of constant (non- 
extended) resolving time, while a scintillation counter and a 
mechanical recorder both approximate to ideal counters with 
extended resolving times. 


4.6.1 Counters with fixed resolving times 

If x is the rate of occurrence of the events and uo the rate of 
counting, the counter is insensitive for a time + for each event 
counted, and so over a long period 7 it is insensitive for a time 
(uo t) r. The number of events occurring in this insensitive time 
is (zo t7), and so, equating the number of events occurring to the 
number recorded plus the number missed, 


pt = pott ui , 


— am dit que 1 
1 一 poT， Ho 1 十 Pr- ( ) 


or m 


This gives the correction which should be applied to the observed 
counting rate to obtain the true rate. 


4.6.2 Counters with extended, resolving times 

An event will be recorded in the small interval t, dt if an 
event occurs in this interval, the probability of which is udt, and 
if the counter is sensitive. The counter will be sensitive if no 
event has occurred in the interval 7 preceding t, and the proba- 
bility that no event has occurred in an interval 7 is from (4.3.1,2) 
er. Hence the probability uo dt of an event being recorded in 
the interval t, t+ dt is given by 


Ho dt = pdt om, 
and the recorded rate is 
Ko = pe. (1) 
The true rate ; can be found from the observed rate u, by solving 
this equation. 
If ur is small, e-#r is approximately equal to 1/(1 + ur), and the 
correction formulae (1) and (4.6.1,1) are very similar. 


4.6.3 Example 

The resolving time of a Geiger counter is 1:6 x 10-* seconds. 91,254 
counts were obtained over a period of 5 minutes from a gamma-ray source. 
What is the corrected counting rate? 

The observed counting rate is 


Ho = 91,254/5 x 60 = 304-18 counts/sec., 


4.6 COUNTING LOSSES 79 
and so the corrected counting rate is 
H = Mo/(1—po 7T) = 304-18/0-9513 = 319-8 counts/sec. 
If the counter had had an extended resolving time, the corrected 
counting rate would have been given by 
304-18 = exp ( — 1-6 x 10-4 u), 


the solution of which is u = 320-2 counts/sec. 

Since the resolving time 7 is seldom known very accurately, it is very 
desirable that ur should be much less than unity if accurate rates are to be 
determined. 


4.6.4 Scaling circuits 


Mechanical recorders have a resolving time of the order of 
0-1 second, and so are unsuitable for fast counting. To over- 
come this, it is usual to insert a scaling circuit between the input 
and the recorder so that only every Nth event actuates the 
mechanical recorder. If n; is the number of events at the input, 


n. =nN +v, v«N, 


where 7 is the number shown on the recorder. Provision is usually 
made for observing from the state of the scaling circuit the 
number of additional events v. 

If N or more events occur in the dead-time 7 of the mechanical 
recorder, counts will be lost. If the number of events lies between 
N and 2N, one count will be lost, if the number lies between 2 
and 3N two counts will be lost, and so on. In practically all 
cases the scaling factor is chosen so that this loss will be very 
small. The probability that at least N events occur in time 7 is 
from (4.5,3) 

o = S Cz ern (1) 


and the probability that 2N or more events occur in time 7 will 
be assumed negligible. Hence the probability that the recorder 
will lose one count during the interval + is equal to Q(N |ur), or 
Q(N | u7) is the fraction of the counts lost. 

It is customary to select a value of W such that this fraction 
is negligible rather than to attempt to apply corrections. The 
value of N for which Q(N | ur) has the value o can be found from 
tables of the sum on the right-hand side of (1) (Molina, m 
Formula (4.5.1,45) can also be used, in the form 


Ar = (JN + X”), (2) 


where the values X" are those for the lower limit in Table 4.8a. 
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4.6.4.1 Example 

The counting rate in Example 4.6.3 is about 300 per second. For what 
value of the scaling factor N will the counting loss be less than 0:1% if the 
mechanical recorder has a resolving time of 0-1 second ? 

Here pr is 30, and from Table 4.80 X” is about —1:5 for x = 0-001. 
Hence (4.6.4,2) gives 


N = (430-- 1:5)? = 49, 


while, from Molina’s Table II for a = 30, Q(48 |30) = 0-001488 and 
Q(49 30) = 0-000887. A scaling factor greater than 48 is thus required. 


4.7 NOTES AND REFERENCES 


(4.2) An expository account of the y? test is given by Cochran (1952); see 
also Cochran (19545). 

(4.4) The usual approach in statistics is to treat the Poisson distribution 
as the limit of the binomial. See, for example, Kendall (1948, I, Ch. 5). 

(4.5) Surveys of testing and estimation methods are given by van Klinken 
and Prins (1954) and Walsh (1954). Approximations to the Poisson 
distribution are discussed by Blom (1954). Cox (1953) discusses approxi- 
mate tests. 

(4.6) Elementary treatments of counting losses are given by Lewis (1942), 
Bleuler and Goldsmith (1952), and Korff (1955). More extended discussions 
are given by Blackman and Michiels (1948), Feller (1948), and Elmore 
(1950). 

48 TABLE 


TABLE 4.8a 


Values of X” for the square root approximation 
to the Poisson distribution 


0-001 0-005 0-01 0-025 0-05 
Lower Upper | Lower Upper | Lower Upper | Lower Upper Lower Upper 


163] 一 1.30 | 一 1:15 
1-62 | —0-93 1:31 | 一 0.90 1:16 
1-62 | 一 1.09 1.31 | —1:03 1:17 
1'61 | —1:15 131| 一 107 1:17 
1-61 | —1:20 1.31 | —110 1:17 
1-60 | —1:23 131| —1:'13 1:17 
1-59 | —1-26 1:31 | 一 114 1:17 
158 | —1:27 1:30 | 一 115 1:17 
155 | 一 1.29 1.20 | —1:16 1:16 


PART II 


REGRESSION THEORY AND THE 
STRAIGHT LINE 
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CHAPTER 5 


REGRESSION CURVES AND FUNCTIONAL 
RELATIONSHIP 


In this chapter an account is given of the basic theory of regression 
curves and of curves of functional relationship, as a prelude to 
the discussion of practical methods of curve-fitting in later 
chapters. 


5.1 REGRESSION 


The term 'regression' was originally introduced by Galton (1886), 
in an investigation of the relation between the heights of parents 
and the heights of their children. The observed heights are 
denoted by the symbols zi and y, respectively, and the range of 
the variable x is divided up into & number of small intervals 
* idx. If y, denotes the mean of all the y; in the interval 
centred on a, the points (£a, Yn) were found to lie approximately 
on the straight line 


y—9 = bir &), (1) 


where z and y are the means of all the observed x; and y; The 
value obtained by Galton for the coefficient b,, was about $. 
Hence if the height of the parent differs by an amount £ from the 
mean z of the heights of all the parents, the height of the child 
will on the average differ by an amount $£ from the mean 7 of 
the heights of all the children. There is said to be a tendency 
in the next generation to return or regress towards the mean. 
Thus the name 'regression line' has attached itself to lines of the 
form (1), and is used generally, even though the two variables 
may be of a different nature and there can be no question of a 
regression in Galton's sense. Equation (1) is said to give the 
regression of y on z. 

If the range of y is divided into small intervals z, + d, and 
the means 2, of all the values z; in the interval centred on ½ are 
plotted against y», the line obtained has a slope different from 
b,,. The line is written 


(x—£) = by,(y — 9) 


and is referred to as the line of regression of z on y. 
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5.1.1 The general regression curve 

The distribution of the observations (x; y;) wil be given by 
the frequency function f(x,y). This function can be split up in 
two ways: 


f(xy) =Alx)gily|x), f(x,y) = fv)gsxlv). (1) 


方 (>) gives the probability of obtaining a value z, g,(y|x) gives 
the probability of obtaining a value y when the value z is specified. 
Both these functions are strictly probability-densities; when multi- 
plied by dz and by dz dy they give the probabilities. 

The regression curve of y on x is defined to be the curve of the 
average value of y for a fixed z, as a function of the variable z. 
In terms of the frequency function the equation U(x) of the 
regression curve is 


E (z, y) dy fonw ) dy 
Je, y)dy Í ga(y |x) dy 
The regression curve may in the simplest cases be a straight line, 


but more generally it may be represented (at least approximately) 
as & polynomial 


U(x) = g(x) = = (2) 


U,(x) = XB pj 25 (3) 
of degree p in x. In the determination of the regression of y 
on z, y is referred to as the dependent variable and x as the 


independent variable. 
There will also be a regression curve of x on y, 


ea [esta 
egw IET 


which will differ in form from the regression curve (2). 


U(y) = £(y) = E(x|y) = (4) 


5.1.2 Correlation ratio 
The correlation ratio of y on z, %, is à measure of the ratio 
of the scatter of the observations from the regression curve to 
the scatter from the grand mean Y. It is defined by the equation 
I- = E{y(x) e Y), (1a) 


where Y is the average value E(y). If the scatter is independent 
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of the z coordinate, (1a) can be written 


1—»2, = (vary a) / var y). (15) 
The form vary|z = (l—7?,) vary (1c) 


is often used in statistical literature. The variance on the left- 
hand side refers to deviations from the regression curve, the 
variance on the right to deviations from the grand mean. 


5.2 TYPES OF VARIABLE 


The variables which occur in practice seem to fall naturally into 
two distinct classes. Firstly, there are those variables which can 
be altered more or less at will by the experimenter, and which 
might be called 'controlled' variables. Such variables often occur 
in physical experiments. For example, in the measurement of 
the variation of electrical resistance with temperature, the values 
of temperature at which the measurements are made are under 
the control of the experimenter. Secondly, there are quantities 
which are inherently variable, where the values are outside the 
control of the observer. Such ‘uncontrolled’ variables are common 
in the biological sciences. The heights of parents and children in 
Galton's investigation (8 5.1) are typical examples of uncontrolled 
variables. 

The frequency function f (x) associated with an uncontrolled 
variable is à fundamental characteristic of the quantity being 
measured. For controlled variables the frequency fi(x) of the 
occurrence of a particular value is at the discretion of the 
experimenter. 

In point of fact, the procedure for the estimation of the regres- 
sion curve U(x) follows the same pattern whether the inde- 
pendent variable is controlled or uncontrolled. This comes about 
because (5.1.1,2) for the regression curve does not depend on the 
frequency function 方 (>) but on the function 910% z). 

Both types of variables may also be subject to experimental 
errors which cause the observed values z and y to differ from 
the true values x’ and /. The errors 


= =, の 6 テニ ター が (1) 


are attributed to the effects of small unaccounted changes in the 
experimental conditions. The basic assumption that will be made 
is that the errors y and 8 are random variables, equally likely to 
be positive or negative for any particular observation. Thus, 
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whatever the values z' and y' may be, 
E(y|z^,y,8) = 0, E(8|a', y^ y) = 0; (2a) 
E(z|z',y',9) , E(ylz,y.y =y". (25) 


For a variable which would be a controlled variable in the 
absence of errors, the presence of errors usually means that the 
observer can only set the value in the neighbourhood of a selected 
value; such a variable may be referred to as partially controlled. 
If the observed value z can actually be adjusted to any selected 
value (which will differ by an unknown amount from the true 
value), the variable z is again controlled. 

When there are errors present, the experimental regression 
curves relating the observed variables z and z are usually different 
from the error-free or corrected regression curves relating the 
true variables z' and y’. 


5.3 ESTIMATION OF THE EXPERIMENTAL 
REGRESSION CURVE 


Equation (5.1.1,2) will give the regression of y on z if the frequency 
function is known. But the form of this function can only be 
determined from a very large number of observations, and in 
practice the number of pairs (x; y;) is usually quite small. Hence 
some method of estimating the regression curve when only a 
small number of observations is available is required. 

The usual procedure is to adopt the least-squares principle as 
the criterion for determining the best approximation 


p 
u, (z) = pu a! (1) 


to the actual regression curve Ce). On the least-squares principle 
the values b,; are chosen so that 


2 
iU = Ey Up (ee)? = A 二 (2) 


is a minimum. v, is the distance measured in the y direction of 
the observed point (x;,y;) from the estimated regression curve. 
Differentiation of (2) with respect to the b,, leads to the equations 


often called the normal equations. 
Any coefficient ba, obtained by solving (3) can be shown to be 
an unbiased estimate of Bp; in the sense that if the experiment 
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were repeated a very large number of times the mean of all the 
values bp; obtained would tend to B, For, from (5.1.1,2) and 


5,1:1,3), : 

e E(y,|2) = Uj(2) = EB l, 

and so the expectation of the left-hand side of (3) is 
E B., -E (b,; ) > 1K. 


This will only vanish for the p+1 value of the index k if the 
individual expressions in curly brackets vanish. Hence 


E(b,;) = By; . (4) 


i.e. bp; is an unbiased estimate of Ba,. 


5.3.1 Postulates om which the estimation of regression curves may 
be based 

The least-squares principle may be accepted as a fundamental 
postulate, and this is perhaps the simplest procedure. Alterna- 
tively, the regression curve may be estimated on the basis of & 
maximum likelihood principle. 'This involves some assumption 
regarding the deviations of the observed y; from the regression 
line values LB - that is, regarding the form of the frequency 
function g,(y |z). 

If it is assumed that the deviations follow a normal law with 
standard deviation o independent of z, then the probability of 
obtaining à value y; is proportional to 


exp (v. Z Bpa) fas (1) 


Hence the probability of obtaining the observed set y, is pro- 
portional to 


exp-z( Ee [202 (2) 


The values B,; are unknown. The method of maximum likelihood 
states that the best estimates b,, of the B,; are those for which 
the probability of the occurrence of the y, actually observed is a, 
maximum. That is, the b, are chosen to minimize 


(u- Nee) (3) 


However, (3) is identical with (5.3,2), and so under these assump- 
tions the maximum likelihood estimates are identical with the 
least-squares estimates. 
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For other forms of the deviation law the least-squares and 
maximum likelihood estimates will differ. But in most cases the 
deviation law will have some symmetrical form not very different 
from (1), and it is probable that the least-squares and maximum 
likelihood estimates wil be very nearly equal. Since the former 
estimates are unbiased and readily calculated, they will almost 
always be adequate. 

An alternative postulate is that the estimate b;; be chosen so 
that its variance has the smallest possible value. It is interesting 
to observe that, whatever the form of the deviation law, the 
minimum variance postulate leads to estimates which are identical 
with the least-squares estimates. This is sometimes referred to 
as the Markoff theorem. The proof of this theorem will be post- 
poned to $ 8.3. 


5.3.2 Weights 

The least-squares form (5.3,2) will be appropriate when iv can 
be assumed that the scatter of the observations about the regres- 
sion curve is the same at all points—when the standard deviation c 
is independent of z,. If it is known that the scatter is different 
for different points on the curve, the value v? should be weighted 
by dividing by o?, the expectation of the square of the deviation. 
The least-squares principle then makes 


zz) [A= epe] o 


a minimum, with Ww, = 07/07 (2) 


and o a constant, the standard deviation of an observation of unit 
weight. Differentiation of (1) leads to the normal equations 


Ev. -— > 557 ai) z£ = 0. (3) 


It is clear that the maximum likelihood principle, assuming 
the deviation law (5.3.1,1), leads to the same equation, since the 
probability of obtaining the values y; is proportional to 


exp > (一 と 6。, 4) / 20 = exp — > 567 %/ — Tb )? / 202. (4) 


It can be shown that the estimates obtained from any set of 
equations of the form 


> NO p 一 $;, al) af = 0 (5) 
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will be unbiased. For, as in $ 5.3, the expectation of (5) gives 


Z (B, - E5,)) YH = 0, 


and so E(5,,;) = B,. (6) 


The weights A; = w,oco;? lead to the estimates of smallest 
standard deviation, by the Markoff theorem (88.3). However, any 
other weights A; may be used if this seems desirable, the estimates 
so obtained being still unbiased but somewhat less accurate. 

If the weights w; cannot be taken as constant, their deter- 
mination in any particular example may prove difficult. One 
special case of interest is that in which the error-free values z 
and y; lie exactly on a smooth curve, so that x; and y; are con- 
nected by the functional relationship 


y; = EB. (7) 
Then var y;|z; = var (y; + 8,) |z; 
= var (ZB, (v, — yz) de) |. 
Thus if c; is the slope of the curve (7) at the point x; (1.2,14a) 
gives - , 
WI! var /,, = var &,. + c7? var y, | Lio (8) 
Usually a rough estimate of the slope of the experimental regres- 
sion curve will be a sufficiently good approximation to c;. It is 
clear that even if the standard deviations of the errors y; and ô; 
are constant, the weights w; will not be constant unless c; is 
constant—that is, unless the functional relationship is linear. 


5.3.3 Prediction 

Often the purpose of the curve connecting the variables x 
and y is to make predictions. That is, to estimate the most likely 
value of one variable, say y, when an observation of the second 
variable yields a value x). If this most likely value is taken to be 
ECU co), the prediction curve or calibration curve is simply the 
regression curve of y on 2. 

It should be emphasized that it is immaterial whether the 
observed values x and y contain experimental errors or not. 
The only requirement is that the measurement z, on which the 
prediction is being based should be made under the same experi- 
mental conditions as were the observations z;,y;, from which the 
regression curve was calculated. The predicted value y is the 
expected value an observation would yield under these experi- 
mental conditions. It is not necessarily an estimate of the error- 


free value y’. 
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5.4 THE ESTIMATION OF THE ERROR-FREE CURVE 
WHEN THE DEPENDENT VARIABLE 
IS SUBJECT TO ERROR 


If y, is subject to experimental error, while z; is free from error, 
yi = Yi + 8, *. = z$, (1) 


there will be two regression curves giving the regression of y on z, 
the experimental curve 


g(z) = EU) = B,, (2) 
and the error-free curve or corrected curve 

y'(z) = E(y' |z) = Bg, s. (3) 
But E(y|x) = E(y'|z) + E(8|z) = E(y'|z), 


as ô is a random variable, and so the two regression curves in 
fact coincide. 

It follows that the estimated experimental regression curve 
can be used also to predict the value y' on the corrected or error- 
free regression curve corresponding to an observed value z,. The 
effect of the error is merely to increase the standard deviation. 


Por vary = E(y ZB, xi)? = Ely’ d- LB. zy. 


Since the variable 8 is a random variable, 


E(8|y', x) = 0. 
Thus E(y'8) = 0 = E(827), 
and so var /* = var y'|z-r varó|z, (4a) 
or o? = of, + oj. (4b) 


5.4.1 Functional relationship 

One particular case of considerable importance is that in which 
the corrected points zx’ and y’ lie exactly on a smooth curve, so 
that the error-free values are connected by the functional 


relationship y' = XBLz (1) 
219. 


The functional relationship can be regarded as a limiting form of 
regression curve, when the standard deviation o of / for fixed x’ 
becomes zero—when there is a single value y' corresponding to 
the observed value x’. 

When the independent variable is free from error, x = x’, the 
estimated experimental regression curve will also provide an 


5.5 THE INDEPENDENT VARIABLE 91 


estimate of the functional relationship between the error-free 
variables. The standard deviation o, will simply be that of the 
experimental error, o. This particular case corresponds to the 
classical curve-fitting problem, and most curves in physics will be 
of this class. 


5.4.2 Choice of independent variable in determining functional 
relationship 

The regression curve is, by definition, a single-valued function 
of the independent variable. Hence the functional curve and the 
regression curve can only coincide if the dependent variable is a 
single-valued function of the independent variable; otherwise the 
regression curve will be an average of the various branches of the 
functional curve. Thus if the regression curve is to be an estimate 
of the functional relationship, then the dependent variable must 
be a single-valued function of the independent variable, and this 
restriction may determine in a particular example which variable 
must be the dependent variable. 

If the relationship is very roughly linear, with no maxima or 
minima within the range of observation, each variable is a single- 
valued function of the other. Hence the error-free regression 
curves of y' on x’ and of z' on / will both coincide with the 
functional relationship curve, and either variable may be chosen 
as the dependent variable in the determination of the functional 
relationship. But the estimation of the regression curve is quite 
complicated when the independent variable is subject to error, 
as will be seen in § 5.5. So if only one variable is subject to error, 
this variable should wherever possible be chosen as the dependent 
variable. To summarize: 

(a) if the function has maxima or minima in the range of 
observations, it must be arranged that these are maxima and 
minima in the dependent variable y; 

(b) if there are no maxima or minima, and only one variable is 
subject to error, this variable should be the dependent variable y. 


5.5 THE INDEPENDENT VARIABLE SUBJECT 
TO ERROR 


The experimental and corrected variables are now connected by 


the equations の ニア キッ 。 y-y 5 


There are four possible regression curves relating one variable to 
the other. These are the experimental regression curve y on z, 
the corrected regression curve y’ on z”, and the two mixed curves y’ 
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on z and y on z'. But if the error variable 8 is a random variable 
E(y|z) = E(y'|z), E(y|z') = E . (1) 
Hence the mixed curves coincide with the experimental and the 
corrected curves respectively, and need not be considered separ- 
ately. The experimental curve has been discussed already, so 
that there is only the corrected or error-free regression curve to 
be considered. 
If a series of error-free observations 2;,y; were available, then 
the least-squares normal equations would be, from (5.3.2,3), 


zu EPpy) al = 0. (2) 


But the observed values are x; and y; and the error-free values 
x, and y; cannot be obtained by direct observation. 

As a first approximation, the observed values z; and y; can be 
used for z; and y; in (2), giving . 


Lw,(y;— Xb); ti) xk = 0. (3) 


The weights w; should be inversely proportional to the variance, 
for fixed xj, of the difference y; — LB. By the usual rule, 
(1.2,14a), 


2 
var (y; LB., al) = vary, lc: (EB, a) — 


or Ww; (ob, + 05; + e 051) ^, (4) 
where o2, is the variance of y; for fixed z; and c; is the slope of 
the curve at the point z,. The solution (3) and (4) is that proposed 
by Deming in his book. Comparison with (5.3.2,5) and (5.3.2,6) 
shows that the coefficients in this first approximation are really 
estimates of the coefficients of the experimental regression curve. 

In fact, though z; is an estimate of zt 对 is not an unbiased 
estimate of æ . For 

ai t (z; ＋ , 


and so E(21) = z£ + B の の ー Ey?) t .... (5) 


Hence expressions for unbiased estimates of zf can be obtained 
if the moments (i.e. the expectations of the powers) of the errors y; 
are known. Substitution of these in (2) leads to a system of 
unbiased estimating equations for the bj. 

The approximate values obtained from (3) will be very close 
to the actual values if the errors y, are small. Because the esti- 
mation of the corrected curve is so complex, the regression curve 
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given by (3) is generally used in its place. In most of the sub- 
sequent chapters it will be assumed, unless the contrary is ex- 
plicitly stated, that the error in the independent variable x can 
be neglected, the case where both variables are subject to error 
being only considered in $$ 6.5 and 11.2. 


5.5.1 Linear functional relationship 
If the relation between the error-free variables is linear, 


⁄' = By Biz, (1) 
then the regression curve is given by 
E(y|z) = Bly’ -8|2) 
= E(Bj--Bix--8—Bjy|z), 
or E(y|z) = B Biz — Bi E(y|z). (2) 


The last term gives the difference between the functional line and 
the regression curve. 

The frequency function f(y|x) wil be proportional to the 
product of the error function f,(y|z') and the frequency function 
falx’), for the value & = z—y. If it is assumed that i &“) is 


independent of 2’, 
Fle) /f,(y)fs(z — y) (3) 


Hence E(y|z) will depend on the form of the frequency function 
falx’). Only if f,(z') is symmetrical about the point z will the 
regression curve and the functional line coincide at this point. 

If the distribution of values æ is of the normal form (with mean 
zero) then it can be shown that the regression curve is linear 
when f(y) is also normal. For then 


Faly) fal — y) ec e-i'/c? o—k (z—y)*/£ = ei 0 nb e 一 (07 一 22) 
where a? = e:, ab = £-2. 


It follows that 
E(y|z) = fororis] [foiea 


= [tex — (ay bæ) j dy / [ex — }(ay — bz)?*) dy 


= f a—1(z + bx) e dz / few dz, 


where z = ay—be. 
So E(y|z) = a! = (1+ £o?) x. (4) 


94 REGRESSION THEORY AND THE STRAIGHT LINE 


The regression curve is then a straight line of slope 
B, = By (Y 07/&). (5) 


If the range of the observations is much greater than the standard 
error, the difference between the two slopes will be very small. 

In many experiments f(x’) will be fairly flat over a region near 
the centre of the range, and will drop rather sharply at the ends 
of the range, as in Fig. 5.5.1g. This would correspond to an 
experiment where values of z” distributed more or less uniformly 
through a certain range were observed. Over the central region 
f(x’) is reasonably symmetrical, and, from (3), É(y|z) is very 
small. At the ends of the range f;(z') is decidedly unsymmetrical, 
and the extra term E(y |z) in (2) will be appreciable. The regression 
curve will not be a straight line but will be curved at each end, 
as in Fig. 5. 5. 10. 


5.5.2 Predetermined variables 

An interesting case, first discussed by Berkson, occurs when 
the variable z is limited to certain definite values. Then for the 
value z it is reasonable to assume that f(z’) is symmetrical 
about x, and hence E(y|z) = 0. For this special case the regression 
curve is a straight line coincident with the functional line. 

The types of problem in which the values æ may be pre- 
determined are those in which the conditions may be adjusted 
so that the measuring instrument reads exactly x, but errors due 
to changes or uncertainties in calibration, or to difficulties in 
experimental procedure, cause the true value 2’ to differ from x. 

For predetermined variables, where the true curve is of the 
second or third degree, 


E(y|x) = E(ZBj(x — y) +8) 2} 
= XB; xí (B52 + 3B; x) E(y2 | z), 


if f(y|x) is symmetrical. Hence if an estimate of E(y?|z) is avail- 
able, the departure of the regression curve from the curve of 
funotional relationship can be found. 


5.5.3 Other cases of coincidence 

The case discussed by Berkson is not the only one in which 
the regression line and the functional relationship line coincide. 
The two lines coincide in any experiment for which E(y|x) = 0. 
Thus if it is decided to take observations over a definite range of z, 
then it is reasonable to assume that H(y|x) will vanish—that any 
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observation is as likely to have a positive error as a negative one. 


On the other hand, if the range of z' is limited the two curves 
diverge at the ends, as was shown in $ 5.5.1. 


fi’) 


E(y|x) 


x 


Figs. 5.5.la and b. Graphs illustrating the curvature of the regression line. 


5.6 NOTES AND REFERENCES 


(5.5) General references to the cases where both variables are subject to 
error are: Kendall (1951), Lindley (1947, 1953), Berkson (1950), and 
Jessop (1952). A further discussion of the linear case is given in § 6.5. 

Geary (1953) considers the fitting of a quadratic or cubic when 2 is a 
controlled variable subject to error. 


96 


CHAPTER 6 


THE STRAIGHT LINE 


For the straight line the least-squares principle leads to the 
normal equations whose solution is considered in $6.1 and 
illustrated in Example 6.1.4. The calculating scheme of Table 
6.1.42 is of general use, but in certain cases (especially when 
the observations are uniformly spaced) other schemes may be 
quicker. A guide to the choice of the calculating scheme is given 
in $ 12.1.1. 

The case where the independent variable x is subject to error 
is considered in § 6.5. However, the problem of estimating the 
slope of the line relating the corresponding error-free variables 
often cannot be solved exactly. 


6.1 NORMAL EQUATIONS 


When the regression curve or functional relationship curve is 
linear, the fitted curve is 


u (z) = bo +b, z, (1) 
where the coefficients are chosen to minimize 

Z y, — u, (z;)). 
They are given by the normal equations (5.3.2,3), 


Xw(y;—bgy—b,2;) = O, (2a) 

Dw; z (g — bo — biz) = 0; (2b) 

or 50 Dw, + b, Ewi z, = Xw,y,, (3a) 
50 Zw, &. + b, Xw;22 = Dw, ti Yi (3b) 


The solutions of these equations can be written down explicitly 
as follows: 


b, = (Zw Zw,z,y, Dios v; Zw YD, (4a) 
bo = {— Ew; x; Ew; ti y; + Dw, x? Dw, y,}/D, (4b) 
where D = Zw; Ew; x? 一 (Zw; 2;)?. (4c) 


If the observations are all of equal weight, w; can be set equal 
to unity and Zw; equal to n in all the formulae throughout the 
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chapter. The equations (4a—c) simplify to 


b, = (nXz, y, - Xx, yg D, (5a) 
b, = (— La, Ex; . Lx} Ly,}/D, (55) 
D = N f - (x,). (Sc) 


The calculated values b, and b, can be checked by substitution 
in (3a, b). 


6.1.1 The origin of at the mean 

A change in the origin of the x-coordinate will leave the slope 
of the least-squares line unaltered, but will change the constant 
term b, The system in which the origin of z is at the weighted 
mean leads to specially simple formulae for the coefficients and 
their variances. This coordinate system will be denoted by the 
symbol £, so that 


S = AH (Tur g. Do,) (1) 

and Zw, é; = 0. (2) 
The fitted curve in terms of the variable £ will be written 

U(E) = a +a, Š, (3) 


where a, and a, are the values of constant term and slope for the 
special variable £. 
Equating the fitted values given by (6.1,1) and (3) at the 
point * bs T bx = Qo T a4 (x = &). 
Hence 51 = a, (4a) 
bo = Ay — Za, = aç— (Ew; &, / Lib.) a4. (45) 
The slope and constant term for the variable £ can be obtained 
by substituting £ in (6.1,4a—c). Thus, using (2), 


a, = Xw, e y, Dw E, (5a) 
Ay = EW / / Leos, (5b) 
D = Ew; Zw; ë. (5c) 


The value D, like the slope 5,, is invariant with respect to 
changes of origin. For, from (6.1,4c), 


2 
D = Ew zw x? — Cms zw = Zw, “lw, (. — 7)? = Do. Iw; g, 
1 


and so the value D does not depend on the origin. 
8 


98 REGRESSION THEORY AND THE STRAIGHT LINE 


If the origin of y is also chosen at the weighted mean, the con- 
stant term a, is zero. That is, the line passes through the point 
corresponding to the weighted means. In terms of the variable z, 
(5a) gives 

b, = a, = Ew; — £) yj[Zw(z, — 2)? 
= XwQ(z;-Z)(y,-2)Xw;z—£). (6) 
6.1.2 Standard deviations of the estimates 

The weights w; are inversely proportional to the variances, 
as that vary; = o°ho,. (1) 
Since a, and a, are linear functions of the y;, 

o%(a,) = vara, = Zu? E vary, (Zw; €)? = o/ Nun. Ef, (aa) 
c*(ay) = vara, = Zw? var ./ (C.)? = c?|Zw,. (25) 


If the true values (or population means) corresponding to y; are 
F, then the true values of the coefficients are 


Ay = Nu, I. Löt, A, = Dw; YYXw,&. (3) 
Hence 
COV (ao a1) = H(a— A0) (a4 — Ay) 


= EXw(y, — Te) Zw, £(y; - Y;)|Zw, Lo, & 
= Dw} Et var y;[Zw; Zw; £t, 


and so from (1) and (6.1.1,2) 


COV (ag, ai) = 0. (4) 
Thus for the linear sum 
2 = Ào ao tA, ay, (5a) 
varz = A$ var ao +À? var ai. (56) 
For the fitted value, from (6.1.1,3), 
var ui(E) = VAT Qg + É var ai, (6a) 
or o%[u,(é)] = el +ë n / Zw. (6b) 


The standard deviations for the coefficients and fitted values 
in terms of the variable z can be found very rapidly from these 
formulae. From (2a), as b, = di, ; 


o2(b,) = varb, = o?/Zw; (x; - &) = o? L/ D. (7a) 
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From (6.1.1,45), 


2 
o*(b,) = var bo = en + 22 e» |=, 


* " 2 
" ei 65mm [2w (7b) 
For the fitted value, from (6b), 


G Cui) = e T (z — Z) — /zw 


2 — 
Dos (æ. — z)* 
2 
= e +(x- &)2 e [zw. (7c) 
Equation (75) corresponds to the special case of (7c) for which 


x = 0. The values b, and b, are not independent, but 


cov (bo; b,) = cov (ao — Zay, a4), 


or cov (bo, b1) = —#vara, = M os, (7d) 


6.1.3 Estimation of o from the residuals 
Usually o is not known, but must be estimated from the 
residuals 
v; = y; — Uy (%) = Ye— Uy (Ft) = 一 の 。 一 の £i (1) 
Now (v,) = 0, and, using (1.2,7), 
E(v2) = var v, = var y; var a, + £2 vara; — 2 cov (Yi Go) 
— 2€, cov (Yi, A1) + 2; oOo (A, Q1). (2a) 
But cov (yp ao) = E(y; — Ti) (as — Ap) 
Gu. Y;) Zw;(y; — Y;)/ Zw; 


= zo, var / / Tu. = o*[2ww;, 


or COV (Yi, ao = VAT Ap. (2b) 

Similarly, cov (Yi a1) = Et var ai, (2c) 

and so Ev?) = var y, - vara, — £2 var ay. (3) 
oe | 20; = Wi A 

Thus E(w;v2) = o' h Zw, To 

and EXw,v$ = o*?(n — 2). (4) 

2 
Hence 82 = ANUS (5) 
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will provide an unbiased estimate of the variance c? of an obser- 
vation of unit weight. 

The quantity Xw;v? can be obtained without calculating the 
individual residuals v,. For 


Dw, vz = Xw(y,—a,— a, éi)’, 
and 
Lo. Y, = Ewa, Loy, Š = Ew, Et a, Dw, E. 4e a = 0. 
Thus any of the alternative forms 
lw, v? = Dw, y? ag Xw, — a3 Z2w, £t, (6a) 
Dw, vi = Dw, / —a, Zw, /- a, EW Yi £p . (6b) 
Dw, vz = Xw,y1— (Lao, // T (Ew yi é) [Zw Et (6c) 


may be used to calculate Xw;v?. A sonvenient form in terms of 
the quantities occurring in (6.1,4g-c) is 


Zw, v? = Dwy? — (Zw, y,)?|Zw, — bt D/ Lb.. (6d) 


If the origin is chosen at the weighted mean of the values y;, 
ao will vanish. Hence (6a) has the alternative form 


Xw,v? = Lw,(y;— g) — bj Dw, (x; — &)2. (6e) 


6.1.4 Example 


Table 6.1.4 shows the error y in a, quartz clock, as deduced from transit- 
circle observations on the days z. In Table 6.1.4a the calculations for the 
fitted line and for the standard deviations are shown. The slope of the 
line, corresponding to the mean clock rate, is 84-2 + 0-6 milliseconds per day. 

In all such calculations, a very useful check on the arithmetic is obtained 
by evaluating the residuals v, individually, and comparing the value of 
Zv? with that calculated by means of equations (6.1.3,6a—e). Part (d) of 
Table 6. 1. 44 shows the individual residuals. The sum of their squares is 
0-0300, agreeing with the value 0-0301 obtained in Part (c). The sum of the 
residuals will be zero if no arithmetical slip has been made in calculating 
them. In addition, the signs of the residuals should be examined to see 
whether there are any systematic departures from the fitted line. The 
occurrence of a number of successive residuals of the same sign would 
indicate that the straight line does not fit the observations satisfactorily, 
and the proper curve is a polynomial of higher degree. 


6.1.5 Variation of standard deviation of fitted value with location 
of point 
Equation (6.1.2,7c) gives the standard deviation of the fitted 
value as 


e[u,(2)] = o(Zuw,) [1 +{(Zw;)?/D} (z — A ah. (1) 


Thus the standard deviation is à minimum at the mean value, 
and increases symmetrically on each side of the mean. 
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TABLE 6.1.4 


Error y (in seconds) of z quartz clock as a function of time x 


(in days) 

y x y の 
0-435 3 2:122 23 
0-706 6 2-181 24 
0-729 7 2-938 33 
0-975 9 3-135 35 
1-063 11 3-419 39 
1-228 12 3-724 41 
1:342 14 3-705 42 
1-491 16 3-820 += 
1:671 18 3-945 45 
1:696 19 4.320 49 


TABLE 6.1.4a 
Calculations for Example 6.1.4 


(a) Summations 
Ly 44-645 E Ley 1457-543 Ly? 130-322683 
n 20 Ex 490 Ex? 16324 
(b) Coefficients b, and b, 
D = nXz?—(Xx)!-— 86380 
b, = (nXxy L/) / D = 7274-810/D = 0-0842187 
50 = (—XzcXxy--Xz?2Zy)|D = 0:168892 
Check nb, + xb, = 44:645003 = Ly. 
(e) Standard deviations 


Xy: 130-322683 

— (Zy)*/n 99-658801 

— (b, D)?/nD 30-633746 
= os 0-030136; 5? = Xvt/(n — 2) 0-001674; s 0-0409 


8(b,) = D /n) = s/65・7 = 0-000623 
(d) Residuals 


u v u v 
0-422 + 0:013 2-106 + 0-016 
0-674 + 0:032 2-190 — 0-009 
0-758 — 0-029 2-948 — 0:010 
0-927 + 0-048 3:117 + 0:018 
1-095 — 0-032 3-453 — 0-034 
1:180 + 0-048 3-622 + 0-102 
1:348 — 0-006 3-706 — 0-001 
1:516 — 0-025 3-875 — 0-055 
1:685 — 0-014 3-959 — 0-014 
1-769 — 0-073 4-296 + 0-024 


Zw? = 0-0300 xv = — 0-001 
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If the variable bow (z 一 2) Ew, J(3D) (2) 
is introduced, o[u,(k)] = pio( h o/ Tus, (3) 
where pb (k) = 1+ 3k2. (4) 


Hence the variation of standard deviation is described by the 
same function for all fitted straight lines. This function is tabu- 
lated in Table 6.7a for the range 0(0-05)0-3(0-1)3-0 of k. Equa- 
tion (3) and Table 6.7a enable the standard deviation at a number 
of values of x to be calculated rapidly. 

The factor 3 in (2) and (4) was introduced to agree with the 
treatment of the equally-spaced case to be given in $ 6.3.1. 
Similarly, the suffixes 1 and 0 in po( を ) conform to the notation 
of $ 8.4.5. 


6.1.5.1 Example 

Table 6.1.5 shows the calculation of the clock errors obtained from the 
straight line fitted in $ 6.1.4, together with the standard deviations of these 
estimates calculated by (6.1.5,3), using the value s as an estimate of c. 
Thus on the fiftieth day the estimate is 4-380 + 0-018 seconds. 


TABLE 6.1.5 


Fitted values and standard deviations for clock errors 
(Example 6.1.4) 


u(x) x 10 


169 
590 
1011 
1432 
1853 


2274 
2695 
3117 
3538 
3959 


4380 
4801 
5222 
5643 
6064 
6485 


Q9 CO tO tO tO tO. Frrrr 
388888 88288 
SN S Nana 


6.1.6 The straight line passing through the origin 

A special case which occurs rather frequently is that in which 
it is known on theoretical grounds that Y, vanishes when zx; = O; 
that is, the true line passes through the origin. Then B, vanishes 
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and the equation of the regression line is 
U,(x) = B, z. (1) 
Hence the equation giving the least-squares estimate based on 
n observations x, and y; is 


we Lw,(y;— b, t)? = O, 


ab; 

and so b, = Dw, &. /, / Lo f. (2) 

Thus, proceeding as in the more general case, 
varb, = / Cu , (3) 
Uw, vf = Dwy? — bl Tro, = Dio. i (Zao z y) [Ewei (4) 
and E(Zw;,v?) = (n — 1) o, (5) 
there being only one parameter b, which is estimated from the y;. 
Hence 8? = Xw,v$/(n — 1) (6) 


will provide an estimate of the standard deviation c. 
For the fitted value, 
uix) = b, T, (7) 
and var u(x) = x? var 51. (8) 


6.1.6.1 Example 

In measuring the elastic properties of a metal wire, a number of different 
masses were attached to the wire and the extension y measured for each 
mass. The measurements are given in Table 6.1.6, and the calculation of 
the extension per unit length in the lower part of this table. The value 
obtained is (1:530 + 0-014) x 107? inches/lb. wt. 


TABLE 6.1.6 
Extensions y in units of 107? inches for loads of x lb. wt. 
—— — 


y * y の 
1-9 1-35 7-7 5:20 
2-9 1:86 9-5 6-13 
3-7 2-42 11-7 7-82 
5:5 3-36 14-6 9-43 

yz 362-840 Zy? 555-55 


Ez? 237-1223 = (Lyx)*/La* 655-211 
b, 1-530181 Zv? 0-339 s = J(Xw*/(n — 1)) 0-220 
8(b,) = „N 0-0143 


u v u v 
2-07 — 0:17 7-96 — 0-26 
2-85 4- 0-05 9-38 十 0.12 
3-70 0 11-97 — 0-27 
5-14 + 0:36 14-43 十 0.17 


Xv? 0-345 Xv 0-00 
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If the length L of the wire is measured as 127-23 + 0:05 inches, 
and the radius R as (1-407 0-010) x 10-? inches, the Young's 
modulus Y is 


ULLAM aO 6 . in. 
de > * 13-37 x 106 Ib. wt./sq. in 


The variance of Y will be given by the formula 


var F varb, 4 var R varl 


— 


Y: 3 T R n 
= 0:84 x 10-4 + 2-02 x 10-4 + 15 x 1078 = 2:86 x 1074, 
Hence the standard deviation of the estimated modulus is 
0-23 x 108. 


6.1.7 The bivariate normal distribution 
If x and y are uncontrolled variables, distributed normally 
about zero with variance c, and c, and correlation coefficient p, 


f(x, y) = Cexp — {x*/o2 — 2pay/o, o, +y*/oF}/2(1—p?). (1) 
If this is written in the form 


7(?,9) = f,(z) 2, (z , 


g;(y |) = Cexp—(y—xpo,/o,)*/2(1 — p°) oj. (2) 
Hence, for a given value of z, 

E(y|2) = (poyo;) 2, (3a) 
and var (y |z) = (1— p?)o$. (3b) 
Thus the regression line of y on z passes through the origin and 
is of slope Buy tt iis (4a) 
Similarly, the regression line of z on y, 

z = Byy, 
is of slope By, = ptz/ Fy; (4b) 
and so By, By, = p*. (4c) 


If the estimates b,, and b,, of the slopes are obtained from 
the observations z, and y;, and if the origins of x and y are 
chosen at the means, 

by = Ez, y 222 


and bis = Da, y, 212. 
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Hence the product 
(La; y)? 
Lai Ly? © 
will provide an estimate of p, as was shown in § 2.3.1. 

On comparing (3b) with (5.1.2,1c), it will be seen that the 
correlation ratio 7 and the correlation coefficient p are identical 
when the variables follow & bivariate normal distribution. 


S as asss 
by, by, "^ 


6.2 STATISTICAL TESTS BASED ON THE NORMAL LAW 


If the deviations follow a normal law, then the probability of 
obtaining à value y; is proportional to 


exp — (y; — T.) ͤ 20 = exp — w,(y; — Y,)°/2o°. 
Hence, as in $ 2.5, 
Z(y,—Y)*|o? = Xw,(y, — Y;)*[o* 
is distributed as x? with n d.f. Now 
Dwy: — Y;? = T- A0 A1 £)” 


= Xw, (J- ao — Ay Et) + (ao — A9) + (a, A1) n 


From the normal equations, 
の (9 一 の o 一 の 」 Et) = 0 = Zw; £(y; — Aq a &;). 
Also Do, E. = 0, and so the cross- products in the expansion of 
(1) disappear, and ' 
Za, (g — Y)2/o° = Ew, v/o? + (ao — Ao)2/(c2|220,) 
+ (a, —A,)?/(o?/Zw; E). (2) 
By a rotation of coordinate axes, as in § 2.5.2, it can be shown 
that the three terms on the right-hand side are distributed as x°, 
with n—2, 1, and 1 d.f. respectively, and that the three distribu- 
tions are independent. The proof is given for a, polynomial of 
amy degree in $ 8.2.1, and will not be repeated in detail here. 
Thus, as Zw,v?/o? is distributed as x? with n—2 d.f., 
s? = Dw, v?/(n—2) 
will provide an unbiased estimate of o?. The standard deviation 
of s? is, from (2.5.3,2), 
S.D. s? = o°//{3(n — 2)}, (3) 
and the standard deviation of s, from (2.5.3,4), is 
S.D. s = o[J(2(n — 2)). (4) 
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The x? tables can be used to test the significance of the departure 
of an observed value s from an expected value c. 


6.2.1 Testing of slope 

From (6.2,2), a, is distributed normally about A, with variance 
o*/Xw, é, and the distributions of a, and s are independent. 
Hence, as in $ 3.1.4, 
a,—4, 5,—B, (1) 
s(a,) 8(6;) 
is distributed as ¢ with v = n—2 d.f. The quantity s(a,) is the 
estimated standard deviation of a,, (6.1.2,2a) and (6. I. 2, 7a), 


(ar) = 8/(Zw, Et) = (Zw, vi[(n — 2) Zw, EM. (2) 


Tables of Q(t) can be used to test whether the deviation of a, 
from a hypothetical value A, is reasonable. In particular, setting 
A, = 0, the ratio 


t= 


a b 
m - eal (3) 


will test whether the slope of the line differs significantly from zero. 


6.2.2 Comparison of slopes and fitted values 
If two different determinations aj and aj of slope are made, 
and if c can be assumed to be the same in the two experiments, 


the ratio , pt 
don Q4 —04 


sfai ai) "4 
will be distributed as t with ' +w" = n'--n" —4d.£., by § 3.1.4. 
s(ai - ai) is the estimated standard deviation of the difference, 
obtained from 


8*(a1 — a3) I/ T, £23) + (I/ To Er) 82, (2) 
where s? is the estimate of c? given by the equation 
8? = (Zw; vj? + Xw; v;?)/(n' +n" — 4). (3) 
Explicitly, the ratio is 
CHAM n’ -n'—4 ł 
人 
2. 5» ^' +n" —4 i 
„ t= 0-0 [ssa]: (Sapi ` * 


For the fitted values the ratio 


u-) — ux) c? i 
m に tg + zn (6) 


8 


6.2 STATISTICAL TESTS: NORMAL LAW 107 


can be used to test the divergence between the values given by 
two different determinations. The test of the coefficients 6。 
corresponds to the speoial case z = 0 of (6). 

If the two estimates are obtained by different experimental 
methods, so that c is not the same in the two experiments, 
the ratio : 

bi—bi 


fo2/A'Y 」 e2/ L7 VÀ 7 
ED F0 a 
should be used, the test being either by Behrens’ method (§ 3.5.3) 


or by Welch’s method (§ 3.5). Similarly, for the two estimates of 
the fitted values the ratio 


LUm)- ule) — (8) 
te?[u (2)] + s°[u1(z)]1 
should be used. 


6.2.8 Example 


The clock errors in the 50-day period following that of Example 6.1.4 
were also fitted by a straight line. Table 6.2.3 shows the comparison of the 
coefficients b, and b, for the two periods. For the slopes the value 1-18 for 
t corresponds to a value of Q of 0-24, while for the coefficients b, the value 
2-03 for t corresponds to a value of Q of 0-05. Hence, although the mean 
clock rates are in reasonable agreement, the values at z = 0 are probably 
discordant and it seems very likely that the behaviour of the clock cannot 
be represented adequately by a single straight line covering the whole 
period. 


TABLE 6.2.3 
(a) Comparison of slopes of fitted lines 


bi 0-084292 by 0-08532 bi—bi 1-10 x 10-? 
n’ 20 n” 25 n'-n"—4 41 

Xv? 0-0301 Dorf? 0-0585 Dor 0-0886 
n» D) 2-315x 10-4 n”/D” 1.727 x 104. sum 4-042 x 107* 


t (6.2.2,5) 1-10 x 10-? (1-145 x 10%)? = 1-18 


(b) Comparison of values by z u,(0) 


x 0-1689 5% 0-0650 bg — bg 0-1039 
D 8.638 x 104 D” 14-475 x 104 
(Sc)? 0-2401 x 106 (227)? 3.5721x 10% 52 = Zw$/(n'--mn"-—4) = 0:0886/41 
(8. 1. 2, 70, z = 0) o2[ui(0)]/o2 = {1+ (Zo)?/D')|n' = 0-189 
ce?[4"(0)]/c* = 1:027 sum 1-216 
t (6.2.2,6, > = 0) = 0-1039(380-6)# = 2-03 
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6.2.4 Tests for homogeneity 
When r different sets of observations y;; are made, a straight line 


11% r) = ao + 03; Š; (1) 


may be fitted to each separately. The distribution of the slopes 
a; will now be investigated, on the assumption that c? and the 
true slope A, is the same in each set. 

The variance of the slope a; is 


c? (a) - c? [Ew &3,. (2) 
Hence the weighted mean of all the slopes will be 
where, from (2), 
W, = ejoa.) = Dre fh 6 


The quantity ZW;(a,; — a,)2/o2, which is the weighted sum of the 

squares of the deviations of the slopes from their weighted mean, 

will be distributed as y? with r—1 d.f. Also LM /o will 
j 4 


be distributed, independently of the a,;, as x? with 
Z(n,—2) = n — 2r d.f. 


Hence on the postulate of homogeneity of slopes and standard 
deviations c the ratio 


F = Man Ai) 22200; Vis (5) 
n ァ ー1 一 2r 


will be distributed as F with (r—1,n—2r)d.f. This provides a 
test for the homogeneity of the slopes. 

If the values of the slopes pass the test for homogeneity, d, will 
provide an estimate of A,, with variance given by the equation 


vara, = XW} vara,,;/(2W;)? = (1/ZW,) o°. (6a) 
Since 8? = Iwp v},/(n — 2r) 


is an unbiased estimate of o?, the standard deviation of à, can 
be estimated from the equation 


s*(4,) = s!/EW,. (6b) 


The homogeneity of the values b, can be tested in a similar 
way. If the values b, and b, both pass the homogeneity test, the 
lines may be assumed to be all estimates of the same straight line. 
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It will be noted that the values a, would not be expected to be 
homogeneous in general, since Go; is the fitted value at the point 
corresponding to the weighted mean &, of the z;, in the jth set, 
and the location of this point depends on the values £; and their 
weights % in the particular set of observations. 


6.2.4.1 Example 


The constancy of the clock rate over the 50-day period of Table 6.1.4 
can be tested by subdividing the observations into three groups and testing 
the homogeneity of the three values a,. The calculations are carried out in 
Table 6.2.4. It is found that the spread of the slopes is somewhat less than 
would have been expected from the residuals, but the significance level 
corresponding to F is much greater than 5%, and so there is no reason 
to suspect anything untoward. 

It will be noted that b, is much less accurate than the estimate obtained 
in Š 6.1.4. This is because the range of z and hence the value of E(v— 3)? 
is very much greater for the complete set than for the subdivisions. In 
cases where the slopes and fitted values are in agreement, b, should be 
obtained from the complete set as in $ 6.1.4. 


TABLE 6.2.4 
T'est for uniformity of slopes in sub-sets 


n De Dez Ly Lyx xy: D 
7 62 636 6-478 64636 6608644 608 
16-33 6 133 3135 12099 284.262 285783227 1121 
7 295 192553 26-068 1108-645 97.930812 846 


b,D b, (Zy)*/n b? Din Xv? W = Djn 
50-816 0:08357895 5-994926 0.606735 0006983 3648/42 
96-405 008599911 24.397634 1.381791 0-003802 7847/42 
70-455 008328014 97.077232 0-838215 0-015365 5076/42 

EW 16571/42 


b, = / N = 1402-4610/16571 = 0-08463346 


b, —b, (b, — 5,)? 
0-0010545 0-0000011120 EW(b,—5,) = 0-000666 
0-0013656 0-0000018649 
0-0013533 0-0000018314 Xv? = 0.026150 
26150 2 
= 一 一 Ta G = = 2) = 5:61 
(6.2.4,5) F I ggg”: 14. = 2) = 5 


5% Significance level 19-4 


S.D. of mean slope: s? = 2v?/(n—2r) = 0-001868 
From (6.2.66) 
82(b,) = 0-001868 x 42/16571 = 0000004735 
s(b,) = 0-00218 


110 REGRESSION THEORY AND THE STRAIGHT LINE 


6.2.4.2 Analysis of variance. ' The sums of the squares of the 
deviations can be split up as shown in Table 6.2.44. This scheme 
is an example of an analysis of variance table. Such tables are 
widely used in modern statistical practice. The agreement of the 
total sum of the squares with the value 2ZXw;,yj, provides a 
check on the arithmetical calculations. 


TABLE 6.2.4a 
Analysis of variance table (Example 6.2.4.1) 


Sum of 
Deviations d.f. Squares d.f. 

Of mean value in 

each set from zero X((Zw;yj)?/22w,4) r 127-469792 3 
Of mean slope from 

Zero DM az 1 2-826075 1 
Of each slope from 

mean slope ZW,(a,,—2a,) r—1 0-000666 2 
Residuals Duo, vj, n—2r 0-026150 14 
Of observations from 

zero ZXXw, y? n 130-322683 20 


63 EQUALLY-SPACED OBSERVATIONS 
OF EQUAL WEIGHT 


When the observations are all of equal weight, and the interval 
Az ニタ ュー タダ, between successive values of z, is constant, the 
calculations can be considerably simplified. The variable z is 
replaced by the variable e, where 


4 - = «Ax. (1) 
The spacing between successive values of e at the points of 
observation is 
ュー = (za f/ A = 1, 
and Ze, = 0. Hence the values e, are the integers or half-integers 
If the fitted curve in terms of the variable e is written as 


U(E) = ao +a, e, (2) 
the coefficients a, and a, are, from (6.1.1,5), 
a, = Xe Ter, (3a) 


Ay = Ly,/n. (35) 
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When x is odd the values e; are 0, +1, +2, etc., and the calcula- 
tion of Ze; y; is simple. When n is even, the values e; are the half- 
integers +4, +$, etc. and it is usually more convenient to 
calculate 2£(2e;) y;, and a, from 


a, = jZX(2e) y,/Xe?. (3c) 


The values De? are listed in Table 6.75 for n = 6(1)75. The sum 
Xe? is given by the formula 


Le? = n(n? — 1)/12. (3d) 
For Ze = > (-2-1y, 
j=0 


T 
and を ツー) = (r+ 1)r?—rEj+ Ej? =sr(r + 1) (7 + 2). 
On substituting »— 1 for r, the expression (3d) is obtained. 


6.3.1 Standard deviations 
From (6.1.2,2a, b), 


o) = vara, = / Zet, (1a) 
o*(a,) = vara, = /n. (15) 
Explicitly, formula (1a) is 
oa) = 120% (n — 1) = 12o?[n*(1— n-?), (2a) 
and so o(a,) = 3-4n-3 c, (25) 


neglecting the term u. 
For the fitted value, 


e?[u,(e)] = (由 | regel (3) 
The standard deviation of the fitted value can be put in the form 
an ct(91 = n^ po (Ë), (4a) 
where, using (6.3,3d), 
mo(6) = (1 + 3&9) (4b) 
amd k2 = 4e?| (n? — 1). 


The approximate value 

k = 2e[n (4c) 
will always be adequate. The function p(k) is tabulated in 
Table 6.7a. The expression (4a) is useful when the standard 
deviations are required at a number of points. The region in 
which the observations lie—the region of interpolation—is 


112 REGRESSION THEORY AND THE STRAIGHT LINE 


between k---1 and k= —1. The standard deviation at the 
extremities of the region of interpolation is twice that at the 
centre of the region. In the region of extrapolation beyond 
| た | = 1, the standard deviation increases steadily. 

As in $ 6.1.3, c may be estimated by 


s = (Zvfl(n 2), (5a) 
where Xv? may be calculated from any one of the formulae 
Le}? = Ly? — naz — (Be?) ai, (5b) 
Ew = Ly} a Ly; a1 Le, Yis (5c) 
Do} = Ly} — (Zy)? [n 一 (Ze y / Tet. (5d) 


6.3.2 Return to the original variable 

Usually it will be necessary to obtain expressions for the 
coefficients and fitted values in terms of the original variable z. 
If the fitted curve is written 


us (x) = bo +b, x, (1) 
the conversion formulae are as follows: 
b, = a,/Az, (2a) 
by = 40 515 (25) 
i c*(b;) = o*(a,) (Az)? (3a) 
o*(6。) = o?(a,) +Z? o2(b,); (35) 
e*[u,(x)] = c*(ao) + (z — £)* o2(b;), (4) 
e[u,(k)] = on™ p, (k), (5a) 
with k = 2(z -c) nA. (55) 


6.3.2.1 Dependence of variance of slope on range and on number 
of observations. The variance of the estimate b, is 


varb, = vary/(Az)? Let. 
If A(x) denotes the range of the variable z, 


R(x) = z, —z, = (n—1)Az, (1) 
var b, = 120% — 1)*/n(n? — 1) #2(z), 
or 0001) = (3-47o/Z22 (x) Jm) (1 — 2[m), (2) 


and the standard deviation is inversely proportional to /n and 
to the range of z. 
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If the variable z is not equally-spaced, it is shown in $8.5 
that the standard deviation of b, is equal to the expression (2) 
divided by a factor fi which usually lies between 0-8 and 1-3. 
This factor takes into account the variation in =z? for a given 
value of Z(x) due to differences in spacing within the range. In 
most cases the expression 


o(b,) = 3-470/B(a) Jn (3) 
will be an adequate approximation. 


6.3.3 Example 

In Table 6.3.3 are shown the mirror settings y (in units of 10-3? mm.) 
for successive positions of minimum visibility in a Michelson interferometer 
with a sodium light source. The calculation of the slope of the line fitting 
these observations is shown in the same table. The value obtained for a, 
is (289-77 + 0-47) x 102 mm. 


TABLE 6.3.3 
Positions of minimum visibility with sodiwm light (Example 6.3.3) 


| 2e | Y+ y- M, = Sy = 70441 
1 3648 3353 a, = M,/n = 3522-05 
3 3985 3084 _ _ ; " 
H 人 M, = $22cy = 192699-5 Dei = 665 
7 4546 2514 a, = M/ Def = 289-7737 
9 4817 2204 

11 5123 1929 zy: 303938669 

13 5421 1650 

15 5694 1363 Mau, = Ae 

17 5993 1074 M/ Te! 55839244 

19 6278 763 m vidi 


8 = (Qn 2) = 12-2 
s(a) = Lei = 0-47 


The difference in wavelength of the two components of the sodium 

doublet is given by the formula 

À A = NA. 
Using the values 5896 A.U. and 5890 A. U. for M and A, the value of 
À, An given by this experiment is 5-992 + 0-010 A.U. 

If n is odd the observations are still listed in two columns of equal length 
as in Table 6.3.3, starting at the bottom of the left column with the value y 
for the largest value of e, but the central value corresponding to e — O is 
unpaired. To illustrate the calculating scheme when n is odd, in Table 6.3.3a 
& straight line is fitted to the 17 observations obtained by omitting the 
three largest observations from the set in Table 6.3.3. 
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TABLE 6.3.3c 
The fitting of a straight line when n is odd 


lel Y+ y- M, = Xy = 52476 
0 3084 ao = M,/n = 3086-82 
1 3353 2792 = Xey = 118127 Ee? = 408 
9 3648 2514 i span 4 
3 3965 2204 a, M/ Te: = 289-5270 
S 4546 1856 Sy? 196187700 
6 — 4817 1363 ー773/ 161984152 
7 5193 1074 
8 5491 763 / Le? 34200951 
= 2w? 2597 


s = {Zv?/(n—2)}4 = 13-2 
s(a) = Dei = 0-65 


6.3.4 The estimation of slope from successive differences 
The expectation of the difference 


Ay; = Jii e 
is B, Ax = A,, where B, is the slope of the ‘true’ line. Hence it 
should be possible to obtain an estimate of À, from the difference 
values Ay;. 

Unfortunately, the mean difference XAy;/(n— 1) does not pro- 
vide a satisfactory estimate, for the intermediate observations 
cancel out, and the value obtained is just (y, —9,)/(n— 1). This, 
being based on only two observations, is a very inefficient estimate. 
It will now be shown that, by ascribing suitable weights to the 
differences, the least-squares estimate a, can be obtained. 

The estimate a, is 


dM Ae 12 n ^ i 
where m=e+3(n+1). 


Thus, s — 2m—n—1 = (m-1)(n-(m-1)-m(n-m), 
a, = | Ë (m—1) (n—(m—} yim) 
Den vl [tne — 161 
Sure U- DA [mona 


or a, = "E m(n—m) Ay(m)J(n(n* —1)/6). a) 
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Thus a, is the weighted sum of the differences Ay. Also if 
W (m) = m(n — m), (2a) 


X Wm) = nim - Im = n(n?—1)/6. (25) 


Hence (1) can be put in the form 
a, = EW (m) Ay(m)|ZW (m). (3) 
The weights W(m) are (n—1)x1,(n—2)x2,.... The weights 
W (m) and their sums £W (m) are listed in Table 6.7c for n2(1)55. 
6.3.4.1 Estimation of standard deviation. The standard devia- 
tion o can be estimated from the residuals 


V; = Ay;—a. (1) 
For, as E(V;) = O, 


E(Vi) = var Ve = var (yi41—9:—01) 


= Var Y; Vary,;,14 vara, + 2 cov (a4, y;) 一 2 COV (34,9441) 


= 20? 0 / Les. 
But Tes is 0(n-3), and so the second term can be neglected. Hence 
E(V2) = 20°, (2) 
and s% = ZV2[2(n —1) (3) 


will provide an unbiased estimate of os. 
The corresponding estimate of the standard deviation of the 
slope is, from (6. 3. 1, 24) and (6.3.4,25), 


sy(ai) = (ZVi[(n— 1) ZW 2 (6E V2)Im*. (4) 


6.3.4.2 Example 

The calculation of the spacing of the successive positions of minimum 
visibility for the example of $ 6.3.3 is carried out using finite differences in 
Table 6.3.4. Since this method will often be employed when there is no 
calculating-machine available, the calculations in this example have all 
been done without the use of a machine. It is then advantageous to reduce 
the magnitudes of the differences Ay by subtracting a suitable constant—in 
this case 260. The weights W, and the value ZW, are obtained from 


Table 6.7c. 
The formation of the differences Ay’ can be checked by the equation 


Tay + (n—1) x const. = y(n— 1) — y(0). 
In this case 575+19 x 260 = 6278 — 763. 


Since ZW, A/ / T. = 29-77, the residuals V; may be taken as ^y; — 30. The 
final estimate for the slope is 
a, = 289-77 + 0-43. 
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TABLE 6.3.4 


Calculation of slope using differences (Example 6.3.4.2) 


y Ay Ay’ = A W, W, Ay’ V p 
const. 
(260) 

763 311 51 19 969 21 441 
1074 289 29 36 1044 1 1 
1363 287 27 51 1377 3 9 
1650 279 19 64 1216 11 121 
1929 275 15 75 1125 15 225 
2204 310 50 84 4200 20 400 
2514 278 18 91 1638 12 144 
2792 292 32 96 3072 2 + 
3084 269 9 99 891 21 441 
3353 295 35 100 3500 5 25 
3648 317 57 99 5643 27 729 
3965 265 5 96 480 25 625 
4230 316 56 91 5096 26 676 
4546 271 11 84 924 19 361 
4817 306 46 75 3450 16 256 
5123 298 38 64 2432 8 64 
5421 273 13 51 663 17 289 
5694 299 39 36 1404 9 81 
5993 285 25 19 475 5 25 
6278 — 

575 1330 39599 4917 
xA ZW ZW, Ay’ 272 
log ZW, Ay’ 4:5977 
log ZW, 3・1239 
diff. 1-4738 


EW, A/ / TN 29-77 
a, = const. + ZW, A/ TN + J(6>V2)/n2 
=260  4-29-77 + 429502/400 
= 289-77 + 0-43 


6.3.5 Efficiency of sy 
The variance of the estimate s? is 


var sf = (f- oO = E(sp)—o*— im 1)2 


If the deviations y; — Y; are denoted by Sy,, 
V; ュー 一 の = di- y + 41-2. 


Now the standard deviation of a, is of the order of on, and so 
the deviations 4」 一 g」can be neglected in comparison with the 


EC PI). (1) 
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deviations 8y;. Hence the approximation 
E(XViPp-E > ー 人 = EX > (S- /e) (8 / 1 — Š#/;)°, 
も 
u i d D (By) + (Byers) — 289,813) 
. . x ((8yj)* + (8yj.1)* — 28y; 84541} (2) 
is obtained. 
This can only be evaluated if the form of the deviation law is 
known. If the deviations are assumed to follow a normal law, 
ECO = py = Zo,  E(8y)* (y)? = of. (3) 
Then 
E(V}) = 1204, E(V$V$,, = 60, E(V$V$2,1,,) = 40%. (4) 
Of the (n— 1)? terms on the left-hand side of (2), n— 1 are of the 
first type, and 2(n—2) are of the second type, the remaining 
terms being of the third type. Hence 
ECP) = 12(n — 1) ot + 12(n — 2) of 
+ 4((n — 1)? — (n — 1) — 2(n — 2)? o 
= 4o*(n? +n — 3), 
4 30% | — 
N — _4) = _ " 
and so W 4) | し 3% こ 1) (5) 
The variance of the estimate s? is, from (2.5.3,2), 
vars? = 2o*/(n — 2). 
Hence the efficiency of s is 
vars?  ,, [33-1 
vareb ” $0 + $(n — 1). (6) 


The efficiency of the estimate s? of the variance of an observa- 
tion is thus about 0-67. Since vars? = 40 vars, from (1.2,14a), 
the efficiency of the standard deviation estimate sr will also be 
0-67. These estimates are somewhat inefficient, and if a more 
accurate estimate is desired, it will be best to calculate a, and 
then calculate s from (6.3.1.5Z- の ). 


7 (ep) = 


6.3.6 Calculation of slope by double summation 


In this method the observations are listed in decreasing order 
of z, and the column of y values summed from the top, recording 


n 
the intermediate sums L y; and the final sum 
i=j 


M, = Eyi (1) 
i=1 
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These sums are now added to give the quantity 


a n 
Mi = > Xy. (2a) 
j=1 i=j 
This can be rewritten 
n i n 
M= X DV, = Diy (2b) 
i=1j=1 i=1 


Now in terms of the equally-spaced variable z= taking the 
values 1 to n at the points of observation, the slope is 


Ziy; — Xy; Ti /n 
b, (eg, m S (iim , (3) 


and the denominator is 


X(t 一” = Xe? = n(n? —1)/12, (4) 

which is tabulated in Table 6.75. Hence 
= (Jt, —1(m + 1) ½ / Tes, (5a) 
while ao = Mln. (5b) 


This method is useful when a printing-adding machine is em- 
ployed, as the intermediate sums can then be printed auto- 
matically. 


6.3.6.1 Example 


The calculations by the double summation method for the observations 
given in Table 6.3.3 are carried out in Table 6.3.6. The observed values 


TABLE 6.3.6 
Double summation method (Example 6.3.6.1) 

(37872) (61458) 
6278 4230 2204 
6278 42102 63662 
5993 3965 1929 
12271 46067 65591 
5694 3648 1650 
17965 49715 67241 
5421 3353 1363 
23386 53068 68604 
5123 3084 1074 
28509 56152 69678 
4817 2792 763 
33326 58944 M, 70441 

4546 2514 
87872 61458 M, 982330 
n = 20 Ze? = n(n?—1)/12 = 665 


a, = {M,—}(n+1) Mo/Ze? = 192699-5/665 = 289-77 
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are listed in decreasing order of x, using double spacing, and the inter- 
mediate sums are entered in between the observations so that the quantities 
to be summed lie directly under one another. When the calculations are 
done mentally it is best to recheck the progressive total from time to time 
by direct summation of the last checked total and the intervening 
observations. 
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It is clear that, if W(x) is any function whatsoever for which the 
sum of the values W(z;) =W; at the points of observation is zero, 


ZW, = ZW (zx,) = 0, (1) 
then 
E[ZW;(y;— Bo- By x;)] = 0 = E[S Wy; — By 2;,)], 


where B, and B, are the coefficients of the regression line or 
functional relationship line. Hence 


b, = ZW, yE W; 2; (2) 
will provide an unbiased estimate of B,, the variance of which 
is given by o?(b,)/o? = ZW3(ZW, )?. (3) 
When W, = zo,(z,— &) = wif; 


the estimate is the least-squares estimate, which will be denoted 
by the symbol bf. The efficiency of amy other estimate 5, will be 
given by 


nlb] = var bf / var b, = (ZW; x; |ZW3 Za, (z, ch). (4) 


The estimate b, will be less accurate than the least-squares esti- 
mate, but, if the number of observations is very large, or if the 
computing facilities are limited, it may be best to put up with a, 
slight loss in accuracy in return for a considerable reduction in 
computing time. 


6.4.1 Step function methods for equally-spaced observations 

When the observations are equally spaced and of equal weight, 
it is convenient to replace the variable z by the variable e defined 
in $ 6.3. Then (6.4,2) and (6.4,4) become 


à b, = (ZW, y) (ZW, et) Az (1a) 
an 

5051) = 12(ZW,e;)!|n(n? — 1) DW? = 12n(ZW; %) / TNT. — (15) 

A step function is a function which is constant in magnitude 


over specified ranges of e, the magnitude usually being different 
in different ranges. Now W(e) must be an odd function of e, 
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from (6.4,1), and so, for any arbitrary function f(e), if W(e) is a 
step function > W(e;)f(e;) will be of the form 
i 


i(n—1) k(a,—1) k(a,—1) 4(a,—1) 
区 > - > 0 40 EXE) 
0,4 0, $ 0. à 0,4 
es 16a —1) 


bee. 


0,à 
the numbers }(a;—1) being the values of e at the ends of the 
steps. The function will be referred to as a single-step function if 
m = 1, a double-step function if m = 2, etc. The total number of 
different steps, counting those corresponding to both positive and 
negative values of e and the central step of zero weight, is 2m + 1. 
It is required to find, for any given m, the best values of the para- 
meters a; locating the steps and of the corresponding weights q;. 
The expression ZW,e, will consist of terms of the form 


t d» 


2 E = (a?—1)/4, VE e = 94 (2) 

T£ a; = an, ao =1, (3) 

then ZW, e, = x > qx (o1 aß). (4a) 
k=1 

Similarly, ZW?-a 2 T RR (4b) 


Thus, on substituting these expressions in (15), the efficiency of 
the estimate b, is found to be 


m 2 m 
500 =F East. co) Des. (8) 


The expression on the right may be written as 3(F2/D). To 
maximize 7(5,), the fraction F?/D is differentiated with respect 
to the qx, a, and the resultant expressions equated to zero. On 
differentiating with respect to q;, 


Akı +O = (F |D)q,. 
It is clear that the weights may be multiplied by any arbitrary 
common factor without altering the efficiency. It is convenient 
to choose this factor so that (F/D) is unity. Then 
Opa + Xk = qx. (6) 
On differentiation with respect to ax, 


t —4x,, Y =I to m-; 
Ir 十 J Ak (7) 


Im = 42. 
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Combining (6) and (7), 
pat e+ ュー 2a, 


and so -I Xy = Ag = I- , à constant. 

But oz- ュ 十 Am = Im = Aan, 

amd so Aa = 2am- 

Thus Am q — (m I) A = I- ma, 

and a = 1/ (2m + 1). (Sa) 
2(m — 3) - 1 

Hence Cty = $mal * (85) 
4(m — j 4-1) 

and, from (6), = 一 元 一 一 一 . 

(6) d 2m + 1 (86) 


These give the optimum values of x; and g;. To find the corre- 
sponding efficiency, the numerator 
m 
F = PELLE * — +1) 
must be evaluated. Using (85) and (8c), 
F = U 1*- (2j — 1)9(2m + 1° 
32m(m + 1) 
6(2m + 1) 
Thus, since F = D, the efficiency of the estimate b; is 


1% = BF = 1- pw (9) 


= 32 5 j?/(2m + 1) = 
j 


6.4.1.1 Optimum weights and steps. 'The calculations of the 
previous section can now be summarized. The number of obser- 
vations in the jth step should be 


i(2;4,—1)—3(2;—1) = n- = o) = n|(2m + 1); 


that is, the observations should be divided uniformly among the 
2m 十 1 steps. The weight q;, from (6.4.1,8c), should be propor- 
tional to m—j+1; that is, the weights should be m, m- 1, ..., I. 
The efficiency is then given by (6.4.1,9); 7 is 0-89 for three steps, 
and 0-96 for five steps. 

If the number of observations » is not an integral multiple of 
the number of steps, but 


n=(2m+1)r+v (|v|&m), (1) 
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then the number of observations in some of the steps will be 
r+ 1 instead of r. The methods of choosing the number n; of 
observations in the step of weight j to give maximum efficiency 
when m = 1 and 2 are listed in Table 6. 7d, together with the 
corresponding formulae for ZW, e; 

For the cases m = 1 and m = 2, the values ZW, e; are listed in 
Table 6.7e for n7(1)75. It will be seen that, when v = +1, the 
central group contains + + 1 observations, while when v = + 2 the 
numbers in the two groups on each side of the central one are r+ 1. 
In forming LH, the sum of the n; observations in the step of 
weight j corresponding to negative values of e is subtracted from 
the sum of the n, observations in the step of weight j correspond- 
ing to positive values of e, and the difference is multiplied by the 
weight j. Division of ZN, by TN e, gives bi, and division by 
Az gives the slope in terms of the variable z. 


6.4.1.2 Example 

Table 6.4.1 shows the calculations for the 20 observations of Example 
6.3.3, using single-step and double-step functions. The values obtained for 
b, are 289-84 and 289-68, compared with the least-squares value of 
289-77 + 0:47. 


TABLE 6.4.1 
Solution of Example 6.3.3 by step function methods 


Three-step Solution 
n = 20 127 ァ ニ ニー1 


Xy 
(7) 37872 
(6) 21072 
(7) 11497 


Ee? = 2r2—> = 91 
b, = (37872—11497)/91 = 26375/91 = 289-84 
bo = 70441/20 = 3522-05 


Five-step Solution 
n = 20 r=4 v=0 


Xy 

(4) 23386 

(4) 18716 

(4) 14050 

(4) 9439 

(4) 4850 

Xe} = 10r? = 160 

by = (2 x 23386 + 18716 — 9439 — 2 x 4850) = 46349/160 


= 289-68 
b, = 70441/20 = 3522-05 
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6.4.2 Observations not equally-spaced 


When the values of the independent variable are not spaced at 
equal intervals, it is still true that any function W; for which 
Te, vanishes can be used to provide an estimate b, of the 
slope. However, the optimum function of a particular type will 
depend on the spacing of the observed values z;, and will be 
different in different examples. 

It is possible to describe the departure from uniform spacing 
in terms of two parameters x, and xs, and to calculate the effi- 
ciencies in terms of these parameters. The procedure is compli- 
cated and will be left till $ 8.5, but a brief summary of the results 
will be given here. 


6.4.3 Step function methods for unequally-spaced observations 

The only practicable procedure appears to be to use the same 
steps and weights as in the equally-spaced case (§ 6.4.1.1). 

Table 6.7 f gives the efficiencies, for selected values of the para- 
meters x, and x, describing the departure from uniform spacing, 
when the number of steps N = 2m + is 3, 5, 7, and oo. From 
this table it is seen that five steps (m — 2) are sufficient to give 
adequate values for the efficiency in all cases, while often three 
steps (m = 1) will suffice. 

It will be realized that for the estimate 


bı = ZW, ZW z, 
both the values My, and ZW, x; must be calculated. 


6.4.3.1 Estimation of fitted values. 'To obtain an estimate of the 
coefficient B,, another equation is required. The obvious choice 
is the first least-squares equation 


X(y;—5,—5,7;) = 0 


and then b, = (Xy; - bi C,) / n, (Ia) 
or by = a- b, &, (15) 
where 4 = Ly,/n. (1c) 
The fitted curve is then 

u(x) = a + b,(z — z). (2) 


Now cov (ao, bi) = E(Z(y; - Y;)/n] (ZW;(y; - Y) ZW; x} 
= EW(E(y; — Yi)’ [nE W, £} 
and so COV (ao, b1) = O, (3a) 


amd var u(x) = vara + (z — #)2 var 61. (3b) 
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The standard deviation can then be put in the form (ef. $ 6.1.5) 


o[u,(k')] = n™ apyo(k’), (4a) 
where, from (6.4,3), 
k' =( i hs Mag-. (4b) 
The efficiency of the fitted value can be calculated from the 
* [us 00)] = (ox (Ipso (5a) 
where for the unequally-spaced case (6.1.5,2), 
k = (w—#)n|y(3D), (5b) 
and for the equally-spaced case (6.3.1,4c) 
k = 2e[n. (5c) 


Table 6.7g shows how the efficiencies vary with | k| for selected 
values of x, and , when the fitting is done by single-step and by 
double-step functions. The column x, = 0, ks = O, corresponds to 
the equally-spaced case. The efficiency is close to unity when ん 
is small, and approaches the value 7(6,) when & is much greater 
than unity. 


TABLE 6.4.3 
Solutions of Example 6.1.4 by step function methods 


Single-step Functions 
n/3 = 7 
の 2 >> 
3-14 6:478 62 


16-33 12-099 133 
35-49 26-068 295 


b, = (26-068 — 6-478)/(295 — 62) = 19-590/233 = 0-0840773 
b, = (Ey bi Ex)/20 = 3-447123/20 = 0-172356 


Double-step Functions 


n[5 = 4 
x Ly 2 の 
3- 9 2-845 25 
11-16 5-124 53 
18-24 7-670 84 


33-41 13-216 148 
42—49 15-790 180 


b, = (2x 15-790 + 13-216 — 5-124 — 2 x 2-845)/(2 x 180 + 148 — 53 — 2 x 25) 


= 33-982/405 = 0-0839062 
b, = (Zy bi L) / 20 = 0-176548 
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6.4.3.2 Example 


Table 6.4.3 shows the caleulations for the observations listed in 
Table 6.1.4. 

The values obtained using single-step, double-step, and least-squares 
methods are: 


vr 


by: 0-0841, 0-0839, 0-0842 + 0-0006; 
bo: 0-172, 0-177, 0-169 +0-018. 


The variances of the estimates b, are (ZW?/(EW»z)*g?, while for the 
least-squares estimate the variance is ng?/D. Hence the efficiencies of the 
estimates b, are 


(a) for the single-step, 233?/14 x 4319 = 0-898. 
(b) for the double-step estimate, 405*/40 x 4319 = 0-949. 


6.4.4 Estimation of standard deviation 


The value Xv? can still be used to estimate the standard devia- 
tion of an observation when step function methods are used. 
For, if éi = * — Z, 


v; = y; — Ay — 5, i- (1) 
Now 


cov (yp b1) = E(y, — Y;) EW;(y; I.) / LN. š, = (o*/ZW, Et) Wis 
and, from (6.1.3,2b) and (6.4.3.1,3a), 


COV (/ ag) = vara cov (ao, b1) = 0. 
Hence 


varv; = (vt) = vary; — var ag + £? var bi- 2; cov (Yi bi) 
= O —n-1 62+ ny E var b¥ —2W, £, o° [E W; Ei 


bf being the least-squares estimate of slope. So 


E(Xs3) = no?— 30? + n710? = (n—2)o?--(q;31— 1) . (2) 
It follows that, since 7, is close to unity, 
s = Art / (n — 2) (3) 


will provide an estimate of c, where the residuals v; are calculated 
from (1) But there are no formulae comparable to those of 
(6.1.3,6g-e) for the least-squares case, since here Ly; £, + a, DER. 
The residuals v; have to be calculated individually. 


6.4.5 Least-squares method with grouped observations 

The n observations y; are supposed grouped into N = n/r 
groups, the observations being grouped in order of x; Then, if 
yy; and zy; are the sums of the r values y; and z; in the jth group, 
estimates of the regression line may be obtained by fitting a 
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least-squares line to these V grouped values. If 


£y; = £y; — Ey, (1) 
the estimated slope of the line is 
Qiy = Xy; Enl ZEN (2) 
Now ETL Ex; = E `> £y; ~ Yi 
= - £y; © (4o +4; E.) = AI CEN (3) 
Hence Hayy = Ay, (4) 


and ay will provide an unbiased estimate of the slope of the line. 
The variance of this estimate will be 


var diy = 2(£%; var yy;)/(ZEX;)* 


and as var yy; = T vary, = ro?, (5a) 
it follows that var dy = r g. (Bb) 
The efficiency of this estimate is 

(av) = var af / var a = X£i[rZ &. (Sc) 


The efficiency can be expressed in terms of x, and «xz, the values 
for N = 3, 5, and 7 being shown in Table 6.75. It will be seen 
that in all cases (except x, = 0 = x3) the efficiency is higher than 
for the step function method with the same value of N. The 
calculations, however, take a little longer. The value NV = 5 will 
always give 8 satisfactory efficiency. 

The case x, = 0 = «4 corresponds to the equally-spaced case. 
In this case, if N = 2m+1, the values £y; are proportional to 
m,m —1,...0, . . n, which are the same as the weights in the 
step function method. For the equally-spaced case the step func- 
tion and least-squares grouped methods are identical. 

In forming the groups, if n/N is not integral, but 

m N, |v|€(N—1)/2, 
the v observations should be included in (or omitted from, if 
v is negative) the v groups near the centre of the range of x. 


The corresponding sums Xa, and Ly; are multiplied by r/(r + 1) or 
r|(r — 1), according as v is positive or negative. 


6.4.5.1 The fitted curve. If the fitted curve is written in terms 
of grouped variables as 


UN(Zy) = Qoy + G5 (ty Ax), 
then Aon = Xs N " VV = 1. (1) 
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Hence the estimated curve in terms of the original variable z is 


u (z) = ao +a (x — 2), (2) 

where 4 = T] doy, G, = y. (3) 

Since vara = O /n, (4a) 
it follows that 

o*[u,(z)] = n- o*[1 + -S (UAH AJ (4b) 


6.4.5.2 Estimation of standard deviation. The usual least- 
squares results hold for the residuals v;y. That is, 


E(2v}y) = (パー2) var yy = r(N —2) var Vu (1a) 
and と の = >x, * Nais - (を y = E.) ax. 15) 


Hence the estimate 
8 — Tv / (a = 2r)}* (1c) 


for o can be rapidly calculated. But it is based only on N- 2 d.f., 
and so will not be very accurate unless N is large. If a more 
accurate estimate of c is required, it will be necessary to evaluate 
the individual residuals 


Vi = Yi — Ao — A, (X,—Z), 
and use (6.4.4,3). 


TABLE 6.4.5 
Solution of Example 6.1.4 by the least-squares grouped method 


Calculations for Five Groups 


x YN TN 
3- 9 2-845 25 
11-16 5-124 53 
18-24 7:670 84 


33-41 13-216 148 
42—49 15-790 180 


Zy 44.0645 Xxy 5785-145 Zy? 517-165057 

N 5 Ex 490 Xx? 64794 

D -NXz*—(Xx) = 83870 

b, = (NXxy—ZXa£Xy).D = 7049-675/D = 0-0840548 
bo = (—Xaetay+ Ex? // D = 0-691631 

b,/4 = 0-172908 

Xy? 517-165057 

(Zy)*/N 398・635205 

(b, D)?/ND 118:511786 

= Zw? 0-018066 S = Xv?/(N—2) = 0-006022 sy = 0:0776 
s[b,] = s/J(D/N) = s/129-5 = 0-00060 
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6.4.5.3 Example 

Table 6.4.5 shows the caleulations for the observations of Table 6.1.4, 
when the observations are formed into five groups. The estimate of the 
slope is 0-08405 + 0-00060, compared with the full least-squares value 
0-08422 + 0-00062. The estimate of standard deviation im the grouped case 
is based on 3 d.f. only, and so will not be very accurate. 


6.4.6 Observations of different weight 

If the observations are of different weight, the observation of 
weight w; is regarded as w; observations all at the same value of 
z, in forming the steps or groups. Thus Sw; replaces n in the 
earlier discussions. In forming the steps the observations are 
divided into N= 2m+1 groups in such a way that the sums Lz. 
are approximately equal. 


6.5 THE INDEPENDENT VARIABLE SUBJECT 
TO ERROR 

The cases discussed in this section are those in which the errors 
in the independent variable cause the experimental regression 
line and the functional relationship line to diverge to such an 
extent that the experimental regression line is not an adequate 
estimate of the functional relationship. Cases in which the experi- 
mental regression line is an adequate estimate of the error-free 
regression line or the functional relationship (cf. $5.5) are of 
course treated as in earlier sections of this chapter. 


6.5.1 Estimation of regression lines 
The regression equations in terms of the error-free variable 
T Ew,(y,—bj—biz)z*-0, k-0and 1. (1a) 


These are unbiased estimating equations, in the sense that they 
are satisfied ‘on the average’ by the true values B, and Bj; 


that is EXw,(y,— B¿— Bix!) zk = 0. (15) 


It is shown in § 5.3.2 that the solutions b; and b; are also unbiased 
estimates of Bj and Bj, in the sense that 


E(bj) = B;. (1c) 


When the observed values z; = x+y; are subject to error, 
unbiased estimating equations similar to (1) can be set up if the 
standard deviations of the error terms are known. These equa- 


tions are -— 
Tro. (Z —b, — bi. = 0, (2a) 


Zao (y bo — bi t *. = — bi Zw, o2; (25) 
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These are unbiased in the sense that if the true values B; and Bj 
are substituted the expectations of the two sides are equal. 

A more useful pair of equations is obtained by choosing the 
origins of both z and y at the weighted means. Now 


EXw(z, 2 zy = E(Xw, z2 = (Zw; *)? / Tic. 
= EXw(z, - x)? + E(Zu,y1— wt yr / Lug, 
and EZ, (z; ) (y; N = EXw;(z; —2) (%). 


Thus the unbiased estimating equations for the regression of z 
on z when z and y denote the variables with the origins at the 


means are bo, = 0 (3a) 
and bi (200, xj — Dw, o2,(1 — w;[Zw,)) = Tub. . Ve. (35) 
The weights zo; should be inversely proportional to the variance, 

for fixed z;, of (y; BH — Bi x;). Thus 
20, CC (e$ +o, Bi の りー も (4) 


as in $5.5. It wil only be very occasionally that all these 
standard deviations will be known at all accurately. For the 
special case in which the standard deviations are the same at all 
points—or when they are assumed to be the same, in default of 
further information—w, can be taken as unity and (36) becomes 


biy = Xx, y; (Zo — (n— 1) oF}. (5) 


In a similar manner, the estimated slope of the error-free 
regression line of z' on is given by 


bis = Dw, x, y; {2w y} — Dw, og —w,/Zw,)}, (6a) 


If the standard deviations are the same at all the points of 


observation, 
bis = Lx, y, {Ey} — (n — 1) oF}. (6c) 


6.5.2 The functional relationship 

When the error-free points æ and y; lie exactly on the straight 
san y = Bo + Biz, (1) 
for each value of z; there is a single value of y; given by (I), and 
for each value of y; there is a single value of xi given by the same 


equation. Hence the two error-free regression lines and the line 
of functional relationship all coincide in this case. 


10 
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Since or and oy; in (6.5.1,4) and (6. 5. I, 60) are now both zero, 


ES Bt, = Biz! = Bi, 

the weights w; in (6.5.1,3b) and (6.5.1,6g) can be made identical. 

Then w; = o?| (03; BI 02), (2a) 

and, if k, = og, oh, (2b) 
w; = o? Job, (k, +B’). (2c) 


A knowledge of the relative magnitudes of o and c,;, as well as 
an estimate of the slope Bi, is required before the weighte can be 
evaluated. Often accurate values for these quantities are not 
available. However, in the special case where o and o, are 
constant, the weights are constant and so may be made unity, 
and estimates of the standard deviations are not required for the 
calculation of the weights. 


6.5.2.1 Estimates of the slope. The estimates of Bj obtained 
from the unbiased equations for the error-free regression lines are 


by) = Ew; yi (Zw; — Zw; oy) (1a) 
and bita) = {Zw y? — Dw; og / EW ti Yis (1b) 
where w; = w,(1—w,/Zw,). (1c) 


These equations may be combined to give a third form in 
terms of the ratio k = Ew; oj, Zw, o. (2) 
Combining (la) and (15), the estimate b; is given by 


Ew, yi — bi wy, = k(Lw, x? — bi? Dw, tiy), (3a) 
or bi Ew, 2, y, — bi (lw, y? — kw, 2?) — kXw,x,y, = 0. (3b) 
The solution of this quadratic equation is 

bi = m, + (m? + k), (4a) 
where m = (Xw,y1— kXw,z2)|22w, x, y;. (45) 


This estimate can be expressed in terms of the estimated slopes 
b; and b, of the experimental regression lines. For, on dividing 
(3a) by Ew; . Yi 


bib = kbr bi-, (5a) 

EE STET 

d — iy + (Fry 91 = “iy 1 
and so 51 Pb 77 575 (80) 

An alternative form is 

bia -b 572 —5 

b; = m iy — "ly 
i e Ten T bu TE Fi (6) 


65 INDEPENDENT VARIABLE IN ERROR 131 
6.5.2.2 Ratio of standard, deviations constant. If the ratio 


k = oil oyi (1) 
is a constant, then from (6.5.2,2a—c), 
Ww; = ot ed keel (2) 


where o, and c, are constants corresponding to the standard 
deviation of an error term of unit weight. Hence 


and so Lu, os, = (n—1) oF (3a) 
and 2w; pad (n—1) 0% (35) 
while = 03/05. (3c) 
The estimating equations are then 

bio) = Dw, x, / Tic. f n 1) oF}, (4a) 

bh = (Zw; yf — (m — 1) o$)/Zw t Yi (45) 
and big, = m+ (m? + k) (4c) 
with k = oo の = osos; (4d) 


It is shown in § 6.5.5 that the estimate (4c) can be derived from 
least-squares and maximum likelihood postulates. 


6.5.3 Choice of equation for estimating the slope 
The three estimating equations are 
(a) (6.5.2. 1, 14) and (6.5. 2. 2, 44), which require an accurate 
estimate of o; 
(b) (6.5.2.1,15) and (6.5.2.2,45), which require an accurate esti- 
mate of o; 
(c) (6.5.2.1,4a) and (6.5. 2. 2, 4c), which require an accurate esti- 
mate of o3,/c,; 
Which equation will be used in any particular case depends on 
the information available. It is clear that some information about 
the errors is needed before an estimate of the slope of the error- 
free line can be found. 
The estimate obtained from (c) will always lie between the 
estimates obtained from (a) and (b). For, combining (6.5.2.1,1a) 
and (6.5.2.1,15), 


(Zw; y — bi LW tY) = K Cu. bio) Zw, £i Yi), (1) 


and on comparing this with the equation (6.5.2.1,3a) giving 61, 
it is clear that if b; S bie then br € binh. and so b; lies between 
bitm and biw 
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6.5.3.1 Example 

The values listed in Table 6.5.3 form a set artificially constructed to 
illustrate the calculation of the slope by the various methods. These 
calculations are carried out in the lower part of the table. The three values 
of b: obtained differ only slightly from one another. The standard deviation 
of the estimate b,, of the regression line is 0-04, and this value will serve 
as an approximation to the standard deviations of the estimates b; (see 
8 6.5.4). 

TABLE 6.5.3 


Estimation of slope when the independent variable 
is subject to error 


x y * y 

0-2 0-7 10-1 4:7 

2-3 0-9 11-5 5:1 

2-8 2-8 14-7 7:9 

5:4 2-8 16:3 71 

8-8 3:5 18-1 9-6 
Ly 45-1 IM 567-71 Zy? 282-31 
n 10 90-2 Za? 1163-42 


(a) Sums referred to the mean 
Z(y—-7g) = 78-909 や (ター の) (-A) = 160-908 LX(x—Z)? = 349-816 
(b) Slopes. of regression lines 
biy = (-) (z -&) / (Y -&) = 0-4600 
6 は = X(y—9)*/L(y—¥) d = 0-4904 
(c) Slope of line calculated by assuming o, = 1-0 (6.5.2.2,4a) 
51% = 160-908/(349-816 — 9) = 0-4721 
(d) Slope of line calculated by assuming o; = 0-5 (6. 5. 2. 2, 45) 
bia Í = (78:909 — 2-25)/160-908 = 0-4764 
(e) Slope of line calculated by assuming k = 0:25 (6.5.2.2,4c) 
51 = — 0-026855 + /0-25070 = 0-4742 
(f) Stone of line calculated from (6.5.2.1,6) 
bi = biy + (big — b,,)/(1-- k[b3,) = 0-4600 + 0・0304/2.183 = 0-4739 
(g) Variance of 57, 
Xv) = L(y- p- — bt, E(x — 2)? = 4894 5,,,- 0782 
s(5。。) = 0-042 


6.5.4 Estimation of standard deviations 

The standard deviation of an observation of unit weight can 
be estimated from the residuals for the experimental regression 
curve by the usual formula 

= Lw,v}/(n— 2). 1 
Also from (6.5.2,2a) * 
o? = wi(o5; + B'2 o3) = w; ot; (k; + B3?), 

and so from the estimate s2 of o2 one of the standard deviations 
cy, and og can be estimated if the other is known, or both can be 
estimated if the ratio k, is known. 
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The stamdard deviation of the slope of the experimental regres- 
sion line is 


5%(b,,) = 269.9) bi Luer. . by (ilb). (2a) 


(n— 2) Xw,(x;—3) n—2 
— b 
Similarly, 3 (Diz) ニー = (biz bie), 
and so 8*(b17) = big 5*(b,,) = (b12/b,,)* s*(b,,). (25) 


Thus the standard deviations of bi and by} are very nearly equal. 
Equation (2a) can be written in the form 


な さ ー ム 。。 — SG 

eb) ( , ** 
The quantity on the left is the ratio of the difference of the slopes 
to the standard deviation. If this quantity is much less than 
unity the difference in slope of the two regression lines and the 
line of functional relationship can be neglected. Using the 
approximation (6. 3. 2. 1, 2) for s(b,,), this becomes 


biz に biy si 


| EAM ww o 
, ^ 020 gi p * 029 i: 


showing that the ratio is proportional to /). 

The standard deviations of the estimates of the slopes of the 
error-free line are all very nearly equal to c(b,,). For the estimate 
(6.5.2.1,1a), 


(35) 


and as c,; is supposed known, 
var bio = (biuj)[b,,)? var biy (4a) 


to & very good approximation. Similarly, for the estimate 
(6.5.2.1,15), 
var biz) = (bra y /br2)2 var b = var bi- (46) 


Since (0.5.2.1,5b) expresses bj as the weighted mean of b,, 
and big, the variance of bj would also be expected to be very 
nearly equal to the variance of these quantities. A formula for 
the variance of b: in the case where the ratio k, of the standard 
deviations is constant will now be derived. From (6.5.2.1,3a), 


Ew, yi — kw, x 
EW; . Y; 


bi— kb; = (5) 
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Now 


2w,;y;, _ Xw,yi-kXw,v; | 
1 1 

zz; zy. 。 (Xwm 17 
[s 2kw,r, Xw,yQ—kXw;z; 


— 2 
Xw, Z; N (Zw, xiy)? “3 v) 75 


(abbia — 4k(b! / bi) + k(b! — k/b4)? bz: 
+ 4k? bz} + 4k(bi — / bi) + (b — k|b1)2 bz 


o> , , - — 
— Sw LY (bi + A051) (bx; + kbz}), 


i 


"isi 


and var (b; — k[b3) = (1 + k[b3?)? var bi. 
Equating these two variances, 
, es- CES 

varbi = 60 — a i 


2 
or var b: = (zs) 2m var bi (6a) 


ly 


Usually the approximation 
varb; = var bi (65) 
will be sufficiently accurate. 


6.5.5 Least-squares postulates 

Estimates of the coefficients B, and Bi may be obtained by 
minimizing the sum of squares of deviations. One treatment 
assumes that the coefficients b; and b; and the estimates £; of the 
error-free values x; corresponding to the observed values z, are 
chosen to minimize 

X(y; — H + U(x, E.) /o, (1a) 

with ` 9; = bo + 514. (15) 
Differentiation with respect to the parameters bj, bi, and . 
leads to the equations 


Lox? (y; bo — 51 4% = 0, (2a) 
e — bo —514;) K. = 0, (26) 
es; (y; — 5 — 51 Kt) bi +o: yi (z;— Kt) = 0. (2c) 
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These equations can be solved for bj, bj, and #;. The solutions 
are complicated unless it can be assumed that k; = o$;/o2; is a 
constant. Then, as w; is proportional to og, summing (2c) over 


all values of i and using (2a) gives 
Ew,z, = Dw; fi. (3) 
If the origins are chosen at the weighted means, it follows from 
(2a) and (3) that bj vanishes. Then (2c) gives 
4. = (k+ 512) 1 (y; b + kx) (4) 
and substitution of (4) in (2b) leads to the quadratic equation 
(6.5.2.1,3a, b). Thus when the ratio た , is constant this equation 
follows from the application of the least-squares principle to (1a). 


Alternatively, it may be postulated that the coefficients should 
be chosen to minimize the expression 


Xw(y; 50 — 51 z), (5a) 
where w; also contains the parameter bj. Since 
w; = wil (k; + B3?), 
where w; is proportional to oy, the expression to be minimized is 
Zw; (y; 50 — bi) / (* ＋ bi*). (5b) 
Differentiation with respect to b, gives the normal equation 
ZEw(y; 50 — biz) = 0, 


and so b, vanishes if the origins are at the weighted means. 
Differentiation with respect to b; leads to a complicated equation, 
but if た , is assumed constant this equation also simplifies to the 
quadratic form (6.5.2.1,3a, 5). 


6.5.5.1 Maximum likelihood estimates. If it is assumed that the 
errors follow a, normal law, then the probability of obtaining the 
observed values x; and y; is proportional to 


(eyy* II (ey. 5% exp — iz (i= yl} +S (z, 一 zc , Qa) 


with y; = Bi + B: z. (1b) 


The principle of maximum likelihood states that the estimates 
are to be chosen so that this probability is a maximum. If the 
errors are known, the estimates obtained will be identical with 
the least-squares estimates, as is obvious on comparing (1a) with 
(6.5.5,1a). 
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It should also be possible to estimate the standard deviations 
themselves, as well as the coefficients, by the method of maximum 
likelihood. Such estimates were first obtained by Dent (1935), 
who, for the case when the standard deviations are constant at 
&ll points, derived the equation 


63/62 = b? (2a) 
for the estimates of c, and c,, and the equation 
b; = X(y; 9 (r. — 2)? (2b) 


for the estimate of the slope. But, as Lindley (1947) pointed out, 
(2a) is not ‘consistent’, for the slope Bi of the line and the ratio 
os/g。 are not connected in any way. In other words, the maximum 
likelihood estimate of this ratio is completely unreliable, and the 
slope b: given by (25) is no more accurate than that obtained by 
am arbitrary choice of this ratio. The method of maximum likeli- 
hood breaks down here. 


6.5.6 The method of grouping with both variables subject to error 
For an observed pair of values x; and y;, 
y, — Bo- Bizi = (y; — By — Bizi) d. Biyi 
and so, if W, is an arbitrary function for which 


ZW, = 0, (1) 
ETH. Biæ = EZW(8,— Biyi). 2) 

Thus, provided W; is independent of y; and 8;, 
bi EW, £; = EW, y; (3) 


will be an unbiased estimating equation for Bi. In this method, 
unlike the methods discussed in $$ 6.5.1 to 6.5.5, the standard 
deviations of the errors are not required. 

The most convenient functions W, are the step functions, and 
presumably the step funotions used when the z, are free from 
error will also be reasonably efficient in this case. When the z, 
are free from error (i.e. when z; = t) the observations are listed 
in order of z; before grouping, and if reasonable efficiencies are 
required this should also be done when the z, are subject to 
error. But the values z; are unknown, and the usual procedure is 
to list the values in order of z,. This will be quite satisfactory 
provided the errors yi are not comparable with the spacing of the 
x; near the boundaries of the groups. For then the group into 
which an observation goes—i.e. the value W, in (2)—depends on 
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the error y; and so the right-hand side of (2) does not vanish 
and the estimate will be biased. 

Of course, it is only in cases where the errors are comparable 
to the spacing that the difference between the regression curve 
and the curve of functional relationship is important. Often in 
the design of the experiment the spacing near the boundaries of 
the groups can be chosen so that there is practically no possi- 
bility of an observation going into the 'wrong' group. For 
example, all the observations could be taken near the extremes 
of the range of z, so that there would be no doubt about the 
group into which an observation should go. Sometimes it will be 
possible to order the observations in terms of a third variable. 
Thus if the independent variable is allowed to change with time, 
an unbiased estimate may be obtained by ordering the observa- 
tions in time before grouping. 


6.5.6.1 Example 
For the example of $ 6.5.3.1, using 3 groups, 


bí = (24-6— 4-4)/(49-1— 5-3) = 20-2/43-8 = 0-4612. 


6.5.6.2 Confidence limits in the method of grouping. Bartlett 
(1949) has derived formulae giving confidence limits for B; in 
terms of the significance levels for the ¢ distribution. If 


z = Bi Bix, 
then z; is distributed normally about zero with variance 
c2 = of + B? o2. 
ZWa, Tx glb — Bi) 


—— . / 1 
* eV o, (WD " 
is a, standardized normal variate, and if s, is an estimate of c, 
whose distribution is independent of that of EW; z;, 
gte — Bi) " 
= eG WO P 


will follow a £ distribution. 
An estimate s, can be found by considering the residuals from 
the means of the various steps. Thus for the jth step 


b (5) — > Bi(æ — 2) J: 


is distributed as x2, independently of the mean g; — Bic, and so 
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independently of the sum > Wz; Hence 
1 


82 > b (y — J) — 21 > (944 — 95) (Lja — &,) 
+ BES (ty— 4) n-m B 


will be an estimate of o2 based on n— N d.f., where N is the total 
number of steps. If the three sums of the form 


> > (yj; — 9)? N) 


are denoted by %, Syz and 8, then, from (2), 
t? (- 231 B1? 822) = (Hei)? (bi — By)’, (4) 
where the number of degrees of freedom for t is n — N. 
For a given significance level—i.e. for a given value of this 
is & quadratic equation in Bj whose roots give the confidence 
limits for Bj at the assumed level of significance. 


6.5.6.8 Approximate estimate of standard deviation of the slope. 
From (6.5.6.2,1), 
var {(b; BI) (ZW;2;)) = ZW? e. (1) 
If the experiment were repeated a number of times under the 
same conditions, the proportional variation in the term b;— Bj 
would be considerably greater than the proportional variation in 
TM,. Hence (1) can be written 


var (b; — By) = (ZWT/ (ZW; 2)* oz, 
and 62001) = (ZW/(ZW,z)9) 82 (2) 
will provide an estimate of the standard deviation of bj. 


6.6 NOTES AND REFERENCES 


(6.2) For a test of significance for concurrent regression lines, see Tocher 
(1952) and Williams (1953). 

(6.3) The method of fitting using successive differences has been extended 
by Birge (1947) to polynomials of higher degree. 

(6.4) The fitting of a straight line by dividing the observations into three 
groups goes back to Eddington (cf. Jeffreys, 1948, p. 193). 

(6.5) The estimate (6.5. 2. 1, 4a, b) was apparently first discovered by 
Kummell in a neglected paper published in 1879 (The Analyst, Des Moines, 
6, 97). It was rediscovered by K. Pearson (1901) and Gini (1921); a dis- 
cussion is given by Deming (1943). See also Lindley (1947). 

Grouping methods when both variables are subject to error were con- 
sidered by Wald (1940) and Bartlett (1949); see also Neyman and Scott 
(1951) and Smith (1956). 

For the treatment of similar problems in economies, see Geary (1949), 
Reiersól (1950), Koopmans (1950), and Hood (1953). 


6.7 TABLES 
TABLE 6.7a 
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The function pro( ん ) giving the standard deviation of the fitted value 


pio (k) 


1-0 
1-1 
1-2 
1:3 
1:4 
1:5 


Pp sss par 
の の の ココ の 
€» 09 09 C9 t9. kh9 tO tO tO to 
C» ＋ LO — cO 
= A MI Q 


TABLE 6.7b 
The sums S4, = Xe? 


Su 


1462-5 
1638 
1827 
2030 
2247-5 


2480 
2728 
2992 
3272-5 
3570 


3885 
4218 


4569-5 
4940 
5330 


5740 
6170-5 
6622 
7095 
7590 


8107-5 
8648 
9212 
9800 
10412-5 


o to tp to ty 
つの の び の こ コ の > 


ee 
M 


t3 to to to to t9 
E O02 09 — © 


11050 
11713 
12402 
13117-5 
13860 


14630 
15428 
16254-5 
17110 
17995 


18910 
19855-5 
20832 
21840 
22880 


23952-5 
25058 
26197 
27370 
28577-5 


29820 
31098 
32412 
33762-5 
35150 
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TABLE 6.7c 


W (m) and > W (m) for the fitting of a line using 


successive differences 


n= 2 4 6 8 10 12 14 16 18 20 22 24 26 28 

1 8 5 7 9 11 18 15 17 19 21 2 25 27 

] 4 812 16 20 24 28 32 36 40 44 48 652 

To 915 21 27 33 39 45 51 57 63 69 75 

35 16 24 32 40 48 56 64 72 80 88 96 

g4 25 35 45 55 65 75 85 95 105 115 

165 36 48 60 72 84 96 108 120 132 

386 49 63 77 91 105 119 133 147 

455 64 80 96 112 128 144 160 

680 81 99 117 135 153 171 

969 100 120 140 160 180 

1330 121 143 165 187 

1771 144 168 192 

3300 169 195 

2925 196 

3654 
n= 30 32 34 36 38 40 42 44 46 48 50 652 54 
29 31 33 35 37 39 41 43 45 47 49 51 53 
56 60 604 68 72 76 80 84 8 92 96 100 104 
81 87 93 99 105 111 117 123 129 135 141 147 153 
104 112 120 128 136 144 152 160 168 176 184 192 200 
125 135 145 155 165 175 185 195 205 215 225 235 245 
144 156 168 180 192 204 216 228 240 252 264 276 288 
161 175 189 203 217 231 245 259 273 287 301 315 329 
176 192 208 224 240 256 272 288 304 320 336 352 368 
189 207 225 243 261 279 297 315 333 351 369 387 406 
200 220 240 260 280 300 320 340 360 380 400 420 440 
209 231 253 275 297 319 341 363 385 407 429 451 473 
216 240 264 288 312 336 360 384 408 432 456 480 504 
221 247 273 299 325 351 377 403 429 455 481 507 533 
224 252 280 308 336 364 392 420 448 476 504 532 560 
225 255 285 315 345 375 405 435 465 495 525 555 585 
4495 256 288 320 352 384 416 448 480 512 544 576 608 
5456 289 323 357 391 425 459 493 527 561 595 629 
6545 324 360 396 432 468 504 540 576 612 648 
7770 361 399 437 475 513 551 589 627 665 
9139 400 440 480 520 560 600 640 680 
10660 441 483 525 567 609 651 693 
12341 484 528 572 616 660 704 
14190 529 575 621 667 713 
16215 576 624 672 720 
18494 625 675 725 
30825 676 728 
23496 729 


26235 


6.7 TABLES 141 


TABLE 6.7c (continued) 


n= 8 5 7 9 11 13 15 17 19 21 98 25 327 29 
1 2 3 4 5 6 7 8 9 10 11 12 13 14 

9 3 5 7 9 11 13 15 7 19 21 23 28 27 

lo 6 9 12 15 18 21 24 27 30 33 36 39 

3s 10 14 18 22 26 30 34 38 42 46 50 

60 15 20 25 30 35 40 45 50 35 60 

110 21 27 33 39 45 51 57 63 69 

185 28 35 42 49 56 63 70 77 

980 36 44 52 60 68 76 84 

408 45 54 63 72 81 90 

570 55 65 75 85 95 

770 66 77 88 99 

1012 78 90 102 

1300 91 104 

1638 _105 

2030 

n= 31 33 35 37 39 41 43 45 47 49 51 53 55 
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TABLE 6.7d 


Step functions for estimating the slope of a line; 
n; is the number of observations in step of weight j 


Three steps: % = 3r+v Five steps: n = 5r+v 


Ny No ZW,e, LN fig AW,e, 


r 2r? $ r 10r? 
rl Mister 7 141 102 f 3r 
rtl r 10r® + 7r+ 1 
, = 0-889 7(b,) = 0-960 


TABLE 6.7e 
Values XW, e; for single-step and double-step functions 


ZW, €i ZW,e, ZW,e, 
Single Double Single Double Single Double 


153 265 578 1030 
162 286 595 1071 
171 319 630 1134 
190 342 648 1177 
200 360 666 1210 


210 378 703 1243 
231 403 722 1288 
242 442 741 1357 
253 469 780 1404 
276 490 800 1440 


288 511 820 1476 


300 540 861 1525 
325 585 882 1600 
338 616 903 1651 
351 640 946 1690 


378 664 968 1729 
392 697 990 1782 
406 748 1035 1863 
435 783 1058 1918 
450 810 1081 1960 


465 837 1128 2002 
496 874 1152 2059 
512 931 1176 2146 
528 970 1225 2205 
561 1000 1250 2250 
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POLYNOMIALS AND OTHER CURVES 
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CHAPTER 7 


ESTIMATION OF THE POLYNOMIAL 
COEFFICIENTS 


In this chapter and the next a full account will be given of the 
problems associated with the fitting of a polynomial curve to a 
series of observations. The fundamental ideas and postulates 
were discussed in $5.3, and were shown to lead to the normal 
equations Xw,(y, — Zb, t) zË = 0. 

The solution of these equations using the Gauss-Doolittle method 
will be developed in $7.1. In $ 7.2 the problem will be treated 
from the point of view of orthogonal polynomials, and the con- 
nection between these two approaches will be established. Then 
in $7.3 the two treatments will be combined, using matrix 
notation. The matrix treatment summarizes in compact notation 
the results obtained. It would be possible to develop the theory 
directly in matrix notation, and in fact this approach might be 
preferred by the mathematical reader. However, it is felt that 
the approach given here, in which each step is set out in detail, 
is easier to follow, especially for readers not accustomed to matrix 
manipulation. 

The remainder of the chapter is concerned with various special 
methods of procedure, particularly those applicable to equally- 
spaced observations. In $12.1.2 there is a, guide to enable the 
reader to select the scheme most suitable for any one of the 
various types of example commonly encountered in practice. 


7.1 THE NORMAL EQUATIONS 
The 2 十 1 normal equations for the coefficients b, are obtained 
on the least-squares principle by differentiation of Zac;(y; — Eb, %4)? 
with respect to b,,. As in $ 5.3, the resulting equations are 


Yb Daaka = Luk, k = 0 to p. (1) 

It is convenient to define the symbols 
$j = rot ULF = bys (2a) 
and M, = Iw, y, xk. (2b) 


In terms of these symbols the normal equations are 
Z Prs Pps = Me, k= to p. (3) 
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The quantities Jf, are called the moments. There are two distinct 
stages in the fitting of a least-squares curve: the calculation of 
the values u and My, and the solution of the normal equations. 


7.1.1 Moments and sums of powers 

The values $,; and M, can be obtained by listing the quantities 
w} F, wi y, in columns, and forming the sums of the products of 
corresponding elements in two of the columns. This is done for 
all possible pairings of the columns. For example, the products 
for the columns 20 f, 20 % give the moment Mi. When the 
observations are all of equal weight, the columns are just 27, y;. 
An alternative method which may be used when the weights are 
different is to form two sets of columns, one of values 27, y; and 
the other of values w;zf,w;y;. The columns in one set are multi- 
plied by the columns in the other. In each method the products 
of individual terms are not listed separately but are allowed to 
accumulate in the product register of the calculating machine. 
It is absolutely essential to check very carefully the formation 
of the columns and the final values for % and My. 


7.1.1.1 Example 

Table 7.1.1 shows a series of 67 observations of the mechanical equivalent 
of heat J made at different temperatures í by Jaeger and von Steinwehr 
(1921). The values z are the temperature readings, referred to an origin of 
20? C. The values y are obtained from the observed values J by subtracting 
& constant of magnitude 4-17 and then multiplying by 10*. That is, 


* = t—20, y = (J —4:17) x 104. 


It is usually an advantage to choose the origin of z near the centre of the 
range, since the magnitudes of the powers and moments are then much 
smaller than when the origin is at one end of the range amd greater accuracy 
is obtained for calculations carried out to a given number of significant 
figures. 

The calculation of the moments and sums of powers is best done 
systematically, using the scheme of Table 7.1.1a. It will be assumed that 
the third degree polynomial is required. Powers of ten are removed from 
the values z; and y; to bring them to the order of unity. This enables the 
calculations to be checked by means of a ‘check column’. When the number 
of observations is large it is best to subdivide them into groups of about 
twenty so that calculating mistakes can be detected more easily. Table 
7.1.1a gives the calculations for the last twenty observations of Table 7.1.1. 
The steps are performed in the order described below. 

(a) The values , y are entered, and these columns summed to give the 
entries [z? z] and [x° y] at the bottom of the table (the symbol [ zk] will 
be used to denote Xai , the element in row 23, column z* in the lower 
section of the table). The entries are checked by summing the values in 
the original table of observations. 
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TABLE 7.1.1 


Observations of Jaeger and von Steinwehr (Example 7.1.1.1) 


x y の ダ x y 
— 15-25 291 — 2-59 133 + 5-55 50 
— 14-35 315 —1-58 104 + 6-24 71 
— 13-85 245 —1-58 97 + 6-33 41 
— 13-62 259 — 1-45 104 十 7.76 66 
一 12.59 254 —1:18 117 c T 9-15 79 
—11-49 230 —1:17 104 十 9.19 58 
—11-19 200 — 0-25 106 + 10-60 57 
— 11-05 207 — 0-05 119 + 11:49 88 
— 9:98 176 + 0:01 99 + 12:54 68 
—8:67 202 +1-13 96 + 13-98 45 
— 8-55 175 + 1・15 89 + 14:32 113 
— 8-39 153 + 14:39 69 
— 7:94 187 +1-41 80 十 15.75 83 
ー 7:41 169 4 1:80 83 + 15:79 85 
— 7-40 165 + 2-53 80 + 16-64 173 
— 7:13 101 + 3・24 71 + 17:19 35 
— 6-97 137 4-3-96 76 + 19-41 66 
— 6:03 114 44:11 66 + 23-09 104 
— 6-00 201 + 4:82 60 + 24-34 103 
— 5-12 114 + 5-36 70 + 25:56 25 
— 5-01 118 + 25:79 74 
— 3:69 130 + 26-96 103 
—3:61 137 + 28:36 102 
— 2:67 90 + 29-60 108 


(b) Values x? and g? are entered from Barlow’s Tables. The number of 
decimal places to be retained depends on the scatter of the observations 
from a smooth curve. Here the scatter is rather large, and six decimals 
are more than adequate, but if the curve fits the points closely eight 
decimals may be required. The columns of values z2,z3 are summed 
(entries [x? z2], [z? z?] in the z? row). The columns z, x? are intermultiplied 
(entry [zz2] in z row). If no copying or calculating mistakes have been 
made, this entry should be the same as [x? z?], perhaps differing by 1 or 2 
in the last figure. 

(c) The quantities are now summed horizontally to give the check 
elements 2;: 


3 
z = Laity. 
j=0 
(d) The column of values z; is now summed. If all entries are correct, 
> [x? a] = [z^]. 
j 


(e) The columns are now multiplied in turn by the x column, the sums 
being entered in the z row at the bottom of the table. The entry [rx] 
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equals [2°2*], and so need not be recalculated. The entry [za] equals 
[x° x], and is usually omitted, as are the other elements below the diagonal 
in the lower table. If the calculations are free from mistakes, 


> [zz] = [az]. 


It will be noted that the element [zz9] omitted from the lower table by 
reason of symmetry must be included in this sum. 


TABLE 7.1.1a 


Calculation of moments and sums of powers 


Factors removed: z, 10%, q = 1; y, 107, r = 2 


20 の x? * y z 

1 +2:960 8.761600 十 25.934336 1.08 39.735936 

1 十 2.836 8-042896 +22-809653 1-02 35:708549 

1 +2-696 7.268416 +19:595650 1:03 31-590066 

1 十 2.579 6.651241 +17:-153550 0-74 28-123791 

1 十 2.556 6.533136 -+ 16-698696 0-25 27-037832 

1 十 2.434 5・924356 +14-419882 1-03 24-808238 

1 +2-309 5:331481 +12-310390 1-04 21-990871 

1 41.941 3.767481 + 7.312681 0:66 14-681162 

1 +1:-719 2-954961 4- 5-079578 0:35 11:103539 

1 +1664 2-768896 +4-607443 1:73 11.770339 

1 71579 2-493241 + 3-936828 0-85 9-859069 

1 +1:575 2-480625 + 3-906984 0-83 9-792609 

1 十 1.439 2.070721 + 2-979768 0-69 8-179489 

1 +1-432 2-050624 + 2-936494 1-13 8-549118 

1 十 1.398 1-954404 十 2.732257 0.45 7-534661 

1 +1:-254 1-572516 + 1-971935 0:68 6:478451 

1 +1:149 1-320201 十 1.516911 0.88 5-866112 

1 十 1.060 13123600 “十 1.191016 0.57 4-944616 

1 十 0.919 0-844561 770776152 0.58 4-119713 

1 0915 0.837225 7＋0-766061 0.79 4-308286 Check 
Z0 20 36-414 74.752182 168-636265 16-38 316-182447 447 
* 74.752182 168-636263 406-894568 3069715 717-394163 163 
の < 406-894564 1027-455221 64.492194 1742-230425 494 
x? 2674-462633 148-160059 4425-608746 746 
y 15-4604 275-189803 803 


(f) The columns are multiplied in turn by the g? column. The entry 
[z2z?] equals [zz?]。 and need not be recalculated. However, if it is 
recalculated the check column entry will agree more closely with the sum 
of the values in the x? row, since Z(z?)* will differ from Xx? because of the 
rounding off to six decimals. In checking the entries against the value 
[z° z], the values omitted by reason of symmetry must be included in the 


sum. Thus 
[x° z2] + [wz] + [x z°] 十 [22 x*] + [zy] = e z], 


and [ z] is the sum of the entries in the z? column down to the diagonal 
and then along the z? row. 
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(g) The products of the x? column with the , y and z columns are formed 
and checked. 

(^) The products of the y column with the y and z columns are formed 
and checked. 

The elements in the lower table are the quantities Exi æ}, Sy, F, Dy}, 
for the twenty observations. Similar tables are formed for the remainder 
of the observations, and these are summed to give the final table of values 
ir Mr, Ey*, shown in Table 7.1.15. This final table is checked by com- 
paring the sums of the rows (including the elements omitted by reason of 
symmetry) with the check column values. 


TABLE 7. 1. 10 
Moments and sums of powers for Example 7.1.1.1 


is M, o, check 
67 20-173 98.726409 146-564411 79.90 412-363820 820 
98.726409 146-564410 436-475630 —9-221 692-718449 449 


436-475625 991-695975 113-263288 1786-725708 707 
2722-811792 92-954958 4390-502768 766 


xy? 121-8016 398-698846 846 


7.1.2 The method of single division 

The most common methods of solving the normal equations 
are variants of what Dwyer (1951) has called the method of 
single division. The first step is the elimination of b;, from the 
normal equations, leaving p equations in 551. ., byy- Then 51 is 
eliminated from this set of p equations. This is followed in turn 
by the elimination of bpz bps: ., until finally a single equation 
in b,, remains. The forward section of the method is then com- 
plete. The backward section begins with the substitution of bpp 
in one of the second last pair of equations and the solution of 
this equation for b, ,. The values 55, b. „-i are then substi- 
tuted in one of the third last trio of equations, and this equation 
is solved for b, $, . The process is continued till all coefficients 
down to bpo have been obtained. 

Table 7.1.2 gives in symbols the detailed steps for the forward 
solution when p is 2. It is clear that some systematic notation is 
necessary for the discussion of the method. In one convenient 
notation, the unknowns which have been removed are indicated 
by writing the degree of the unknown last eliminated as a suffix 
separated from the other suffixes by a stop. Thus (2') in Table 


7.1.2 is written 
$21-0 b21 + $22.9 6。。 = Mao. 
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In the general case, if the coefficients up to b, i have been 
eliminated from the normal equations, the resulting equations are 


D LI 
baa bpk 5 M, i-i T to p. (1a) 
TABLE 7.1.2 
The method of single division 
(0) Poo Uso + Fol 521 + dos be: = Mo 
(1) Pio 520 +411 521 +912 bao = M, 
(2) Qao boo 十 の 。 521 + $22 boz = M, 
(0’) = (0) +¢o0 bao 十 col 65」 十 oos b22 = Go 
where aol = の o+/ ず oo, eos = の os/ の oo, ao M/ Goo 
(1^) = (1) ー の :o(07) (6511 r Pro 01 521 * ($i — 6510 ccos) 522 = M, = $10 Go 
(2^) = (2)— @。。(07) ($a = $20 eo) b21 + (Pes = 6520 Gos) bee M — $20 ao 
(1^) = (1’) + ($11 — o G01) 521 T pos = a, 


where ci (0012 — fio 2 / (511 — dio con), 41 = (Mi—di ao)/ ($1 — dio Co ) 


(2”) = (2’)— ($21 — $20 eox) (1^) 
[Peo ー の so os 一 ($= = dao aol) ns] bos LM の so a, 一 ($= m の so ) ai] 


In eliminating b., from this set by the method of single division, 
the equation with r = is first divided by $;;; ,. The resulting 
equation is then multiplied by ¢,; ; , and subtracted from (la) 
for all values of r from j--1 to p. This gives the equations 


D 
> ber. by = MV. g, r=j+1 top. (15) 
k-j41 

Hence Gre. = Gex. 427 95,4397. 11/1. 1 (2a) 
and M, ; = M, 3-1 — Gr. 10. 1/51). (25) 

If the symbols 
S, = Pr} 1 (r 2j) (3a) 
Se, = ó; 1 (kj) (3b) 
A, = a;;; = M; 5-1 (3c) 


are introduced for the elements in the first row and first column 
of the set (la), then (2a, b) become 


Gre. = Pu 1-1 — Sry a (4a) 
and M, ; = M, ュー マダ 7 の (4b) 
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The terms , ; , and M, ; , can be expanded in a similar way, 
and on continuing these expansions the following equations 
are obtained: 


j 
Gr. 22 $= X85 Ok: (5a) 
j 
M, ; = M.— 2 8,4, (5b) 
q=0 


Hence amy particular element can be calculated in terms of the 
quantities ,, V., and the elements occurring in the first row and 
the first column of each set (1a). 

The elements occurring in all the other rows and columns need 
not be recorded, for the whole solution may be carried out in 
terms of the quantities S,,, «,, and a,. From (5a, b), these quanti- 
ties satisfy the recurrence relations 


k-1 
Sin --— Prk — > Sra Cok (rz k) ; (6a) 
S, OA 一 Prk — ES, q “ak (r < k); (65) 


f—1 
S., a. = M. PU 


rq tq 


A.. (6c) 


The final equation in the —— solution is 
の pp の = M, 5-1 (7a) 
i.e. b, = M, S,p = &p- (75) 


The backward solution is, from (la), with + = Ĵĵ, 


£ n bpk = s, 
and as from (3) oj; is unity, 
p 
| = の, 一 Oy Dok. 8 
pj 一 4; a jk zz (8) 


The values b., can then be built up in turn, using previously 
calculated values b,,(k >). 


7.1.3 The Gauss—Doolitile method 

The theory of the method of single division, developed in the 
previous section, applies to a general set of equations. As shown 
there, the procedure can be simplified by recording only the 
leading row and column at each stage. For the normal equations 
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a further simplification is possible, since in these equations the 
quantities o are symmetrical, % = $x; The simplified method 
is due primarily to Gauss, but it was popularized by Doolittle 
and is often called the Doolittle method. 

From (7.1.2, 2a), the quantities $,, ; will be symmetrical if the 
quantities , ; , are symmetrical. Thus, by induction, if the 
original normal equations are symmetrical, so are all the other 
sets of equations obtained by the method of single division. In 
particular, from (7.1.2, 3a—b), 


S, = 05. S; (r >j). (1) 


The Gauss-Doolittle scheme uses (7.1.2, 6a), (7. I. 2, 6c), and 
(7.1.2, 8) 


8, -一 ター 2 Sra A. — Xj. re - (2a) 
r—1 
M, = M.— >e 4, = a, S., (25) 
q=0 
d b 5 2 
an = . 一 "RS 
pj = G; 241 7 pk (2c) 


The scheme is illustrated in Table 7.1.3. Steps 1 to 11 constitute 
the forward solution, steps 12 to 14 the backward solution. 


TABLE 7.1.3 
The Gauss—Doolittle method 


1. Enter Poo = Soo dor = Si Poz = Seo M, = Mo 
2. Divide by Soo 1 Co Cos Go 
3. Enter oy Piz M, 
4. a) x (1) S9 Con S20 Cox Mo Xx 
5. Subtract Su Sn A, 
6. Divide by Sj, 1 Oe CA 
7. Enter $x M, 
8. aoe X (1) so Cos M o q 
9. ous X (5) Sei 053 Mı os 
10. Subtract 822 m ^ 
11. Divide by S。。 1 a, 
12. bes = 42 
18. 5, = ay — 03$ Doe 


14. b, = ao 一 col b21 一 cos Dos 


びれ 
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7.1.4 The abbreviated Doolittle method 
Doolittle recognized that lines 3, 4, 7, 8, and 9 of Table 7.1.3 
were subsidiary to the main calculations, and recommended that 
they be transferred to a separate working sheet. There seems to 
be little advantage in this, but when modern calculating machines 
are employed it is not necessary to record these lines explicitly. 
Their omission leads to the abbreviated Doolittle method shown 
in Table 7.1.4. 


TABLE 7.1.4 TABLE 7.1.4a 


Selection of elements in the 


Abbreviated Doolittle method abbreviated Doolittle method 


Poo gor Poz M 0 


一 -一 一 一 一 一 一 一 一 一 一 一 一 一 一 一 


1 O9 a, 
Sas Ma 
az 


The selection of the correct elements in forming the products is 
simplified by covering unwanted elements with a pair of cards or 
a right-angled template. Thus to calculate the element S, the 
rows of the ¢,, up to k— 1 and the columns of the , and S, 
up to k— 1 are covered. Then the element % is entered on the 
machine, and the products of the a, in the * column and the 
Si, (or A,) in the ‘j’? column are subtracted. The calculation of 
A, is illustrated in Table 7.1.4a: 


A2 = My 一 o。。 Hy — ons Mı. 


The advantage of the method lies in the reduction of the 
number of entries. There is little, if any, saving in time. Because 
of its complexity, the method is not recommended for someone 
fitting curves only occasionally—the full Doolittle method, in 
which each step is set out separately, is much safer. 
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7.1.5 The square root method 
In the square root method, instead of dividing 8% by xz to 
give apj Si is divided by /S,,. The quantities 


Sir = Syl Siem = Ong xx, (16) 
m; = MS; = a; (S55, (1c) 


are recorded. From (7.1.3,2a-b), the equations for the calcula- 
tion of these quantities are 


8, = (4. z pr 2 / Sjj» (2a) 
j—1 

8j; = 2 - Es) > (2b) 

M, = (ar 一 Xn m.) / rM (2c) 


The terms in (2a) are the products of the elements in the + and 
j rows of the quantities s. These are subtracted from $,; and 
divided by s, s; itself is found from the square root of (2b). 
The calculating scheme is shown in Table 7.1.5. 


TABLE 7.1.5 
The square root method 


Poo $o doz M, 
$u $12 M, 


の 。。 M, 

S00 So 820 Mo 
$n 821 m, 

822 Ma 


boo ba baz 


The extraction of the square root is simply accomplished by 
dividing the value in the product register [i.e. the right-hand 
side of (2b)] by an approximate 4 or 5 figure value obtained 
from Barlow's Tables, and taking the mean of the divisor and the 
quotient (cf. the introduction to Barlow's Tables, p. xi). 

The backward solution (7.1.3, 2c) becomes 


の 
by; ar (v. E by.) / 8715 (2d) 
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and it is necessary to divide by s;; in the backward solution as 
well as in the forward solution. 

Though the number of quantities recorded is reduced to the 
absolute minimum, the square root method is even more involved 
than the abbreviated Doolittle method, and is perhaps best left 
to the professional computor. 

For 3 or 4 unknowns there is no significant difference between 
the times required for the calculations in the three methods, but 
if the number of unknowns is large the square root method does 
enable the calculations to be performed more rapidly. Laderman 
(1948) reports that a system of ten equations was solved in under 
three hours by the square root method at the Computation 
Laboratory of the National Bureau of Standards. 


7.1.6 The check column 

It is extremely difficult to solve the normal equations without 
making an arithmetical mistake. Hence the provision of a check 
column becomes almost essential if the correct values are to be 
obtained in a reasonable time. The check column is made up 
of quantities 


C; = P TM; (1) 


which are the sum of all the elements in the jth normal equation, 
including those elements omitted from the Doolittle scheme by 
reason of symmetry. The C; are the quantities used in checking 
Table 7.1.15. They are operated on in just the same way as the 
quantities ¢,, and M, giving rise to values 


9 一】 
em (a- > Sreca) | Sn S „ (2) 
q=0 


The individual components of C, will change under the operations 
according to the rules (7.1.2, 5a, b), and so 


p 
G. 1 = > Prani + M, ri: 
q=0 
Now $,,,., Vanishes for g less than r, and so, from (7.1.2,3a—c), 


p 
G= > ez + Ap (3) 


q=r 


Hence the values c, will provide a check on the accuracy of the 
calculations up to that stage. 
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The quantities c, can also be used to check the arithmetic in 
the backward solution. They are operated on in the same way as 
the a, to produce quantities 


p 
dpa = c= X op dps. (4) 
qT1 
It can be shown that 
ng = lb, (5) 


Perhaps the simplest proof of (5) is by induction. If this equation 
holds for values of the suffix from g+1 to p, then 


2 p の の 
dj, = Co 一 2; lbs = の 。 十 eg 一 2; 0g — a 145,0 
q+1 q q+1 q+1 


from (7.1.3,2c), the value œ, being unity. Hence (5) holds for all g. 
When the equations are non-symmetrical, the columns of 
values ¢,, can be summed to produce a row of values 


C; ーー > Par- (6a) 
q=0 


These are operated on in the same way as the other rows, and 
the operation gives elements 


の p > 
r.r-1 一 2; Part = > 8. (65) 
q=0 q=r 


and these sums provide a check on the values S,,. This check is 
not of interest in the present chapter, since the normal equations 
are symmetrical. 


7.1.7 Changes of scale 


If the check columns are to provide an adequate check on the 
calculations, and if troubles due to misplacing the decimal point 
are to be avoided, it is almost essential that the quantities % 
and M, be all of the same order of magnitude. When the calcula- 
tions of the moments and sums of powers are done by the scheme 
suggested in $ 7.1.1.1, the quantities obtained will be all of the 
same order. Often in the solution of the normal equations it is 
desired to invert the matrix of quantities $;,, Mu, and then it is 
best to take out a further power of ten to bring the quantities to 
the order of unity. If the factors removed from 2 and y are 104 
and 107, and a further factor 108 is removed from all the elements 
to bring them to the order of unity, Table 7.1.7 lists the factors 
by which the quantities given by the Doolittle scheme must be 
multiplied to return to the original variables. 
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TABLE 7.1.7 
Removal of powers of ten in the Doolittle scheme 
æ is divided by 10%. 
is divided by 107. 
Elements Gz. M; are divided by a further factor 105. 
To return to the original variables: 


bpjs 8(b,;), a; are multiplied by 107 10795; 
>o is multiplied by 10 10*; 

$5 is multiplied by 107/108; 

xp Dx; are multiplied by 10¢(3—-*) ; 

Xix is multiplied by 10 10. 


7.1.8 Example using the Doolitile scheme 

Table 7.1.8 shows the calculations using the full Doolittle 
scheme for the example of Table 7.1.1. To bring the quantities in 
Table 7.1.16 to the order of unity, a factor 10? is removed. The 
quantities $;,(— Zz/**) and M,( = Zyx*) are divided by this factor 
and rounded to six decimal places, and then entered in lines 1, 3, 
7, and 12 of the scheme. The sums C; of the elements in these 
lines are then formed, the elements missing by reason of symmetry 
being included. Thus the elements are summed from the top of 
the column to the diagonal and then along the row— 


C, = doa + dia + dos + do; + Ma. 
The quantities C; are then checked against the original values in 
Table 7.1.1b. 

The calculations in each of the four subsections of the scheme 
are performed in order. The value c; at the end of each subsection 
is checked (c; = a;+ Zaj) before proceeding with the next section. 
The column at the far right is used in standard deviation calcula- 
tions and for checking the fitted curve, and will not be considered 
for the present. 

After a, has been calculated, the coefficients ba, are evaluated 
in the lower section of the scheme. Finally, the correctness of the 
solution is checked by comparing Ebs; の ,。 with W. 

To bring the coefficients back to the original scale, they have 
to be multiplied by 10"10-€ = 10210— (Table 7.1.7). Thus 


bso = 92-3894, 531 — — 5.56669, 
bas = 0-406555, bss = — 0:0074431. 


It will be observed that Sa and M, are small fractions of G33 
and Ma, so that it is necessary to retain a fairly large number of 
significant figures throughout the calculations. 
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7.1.8.1 The abbreviated Doolittle scheme. Table 7.1.8.1 shows 
the evaluation of the coefficients using the abbreviated Doolittle 
scheme. The values dz, have been evaluated in the back solution 
as a check on the formation of the coefficients b. Comparison 
with Table 7.1.8 shows that the quantities caleulated in the two 
forms of the Doolittle scheme are the same. 

7.1.8.2 The square root scheme. Table 7.1.8.2 shows the calcula- 
tion of the coefficients using the square root scheme. The check 
column is used in the same way as in the Doolittle scheme. 


7.2 ORTHOGONAL POLYNOMIALS 


The orthogonal polynomials T;(z), of degree j in z, for a set of 
points z; with associated weights w;, are defined by the equations 


Zw) T(x;) = O, Jb. (1) 


These equations determine the polynomials completely, except 
for an arbitrary constant factor. The factor will be chosen so that 
the coefficient of x’ in the expansion of Tyr) in powers of z is 
unity. This expansion will be written 


To) Sue, (2a) 


and the corresponding expansion of 2 as a series in 7,(x) will be 
written 


j 
w= Y oy T,(z), (2b) 
k=0 


Equation (2b) may be regrouped in the form 


T(x) = wi Ses T,(z). (2d) 


To find the relation between au and 5%, the expression (2a) for 
T,(z) is substituted in (25) to give 


j k j 1 
a= Yo X Baa" = Y X Pra", 
k-0  m-0 m=0 kem 
j zl m=j 
where ôm; is the Kronecker delta. Thus 


ji 
Bing = — = Pu Qj. (35) 
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Alternatively, (2b) can be substituted in (2a), giving 


j j 
Zyx) = > > Ont Bj T» (x), 


m0 ken 
j 
and so > ok By; = Om; (3c) 
k=m 
j 
and Bing 一 一 > a Bry: (3d) 
m+1 


Hence the quantities 8, can be calculated if the quantities oj; 
&re known. 
From (2d), by reason of the orthogonal property, 


Dw; T;(x;) Ti(x;) = Uw; 2i Tyle) — cg Dw; T (x) = O, 


or a = Sil Sxx, (4a) 
where Sj, = Dw; a Tyl), (4b) 
Siu = Zw; ak T,.(z;) = Zw, T 2(2,). (4c) 


Now the S;, can be calculated by the recurrence relation 
f 1 
Sf = Zw; Ti * — 2 int T,(z0) E 
m= 


i.e. Six = Pir Tax Sim = 05:4 Ikk (4d) 
with Dix = Ww; xi oF. (4e) 


Hence the quantities S, aj, are identical with the corre- 
sponding quantities defined by (7.1.3,2a) which occur in the 
Doolittle scheme. Thus the ag: can be calculated by this scheme, 
and the coefficients 8,,; by (35). 


7.2.1 Independence of origin 


It can be shown that the value of T;(x) is independent of the 
origin of the variable x. If the variable is changed to 


a’ = z+ E, 
then for the new variable the orthogonal polynomial will be 
T(x’) ニタ ツー Tab Tla’) 
= ot x [xat Ti ei Ew, TE) Te’) 
る 
If it is assumed that Ty. = T,(z) for all k< j, this becomes 


T(x’) = (z+ £y — > È to (z; + £y Tt) / Lo. THe) T, (x). (1) 
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But (x+ £) — z can be expanded in powers of T,(z), in the form 
(z+ £) -zi = > ar Ty (2), 
where > Wi T,(z,) (x; + E) -] = o5; Dw, TRl). 
So on substituting * + > o5. Ti,(2) 
for (x+ g) in (I), à 
Tja) = 0 - Ë wizi T, c) Eu; THe) T,(z) = Tj), 


and the equality of the values of the polynomial in the two 
different variables follows by induction. 


7.2.2 The fitted curve in terms of orthogonal polynomials 
The fitted curve will be written as 


p 2 
% (z) = > a; T,(z) = > 55% 22. (1) 
j=0 j=0 
Substituting for a? the . (7.2, 25), 
p p 
= T bx T, 
% (x) PE pk, Xo aj D(x) = る n pk 1; (z), 
の 
and so a, = Xo byx· (2) 
k=j 


Comparing this with (7.1.3,2c), the a; are identical with the corre- 
sponding quantities in the Doolittle scheme. 
If (7.2,2a) is substituted in (1), 


% (c) = b: 5 5 Bin xi = E = に ガミ キッ 


and SO by; = 之 pn Gy. f (3) 


One advantage of the orthogonal form is that the coefficients a, 
are independent of the degree of the polynomial, so that, if the 
degree is changed from p to p+ 1, the only effect is to add an 
additional term a T,,,,(z) to u,(x). With the power-series repre- 
sentation all the 5,, are altered to new values b,,,;. A second 
advantage arises from the independence of the coefficients a,, 
which considerably simplifies the discussion of standard deviations. 

The quantities A, occurring in the Doolittle scheme are, from 
Pe 1.3,25), related to the moments M; by the equation 


-È 5 Ax. (Aa) 
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TABLE 


The Doolittle scheme 


Factors removed: z, 104, q = 1; y, 107,  — 2; elements divided by 10°,s = 2 


+By Riz 


tB; Rax 


tB; Rax 


Pa | 1. Enter o 0°67 $o 0.20173 
Roo 1-492537 | 2. 二 doo Ooo aol 0-301090 
Roo doo Check 
3. Enter d, 0-987264 
aol 0-301090 4. 1x08 0-060739 
1 —0:301090 811 1 5. Subtract S, 0-926525 
19 — 0:324967 11 21079302 | 6. +S, air 1 
ER の 。, Check 
7. Enter 
o 1-473528 8. 1X dos 
—0-379688 œ; 1-261044 9. 5 X os 
Boz — 1-093840 Bi。 一 1.261044 Bf, 1 10. Subtract 
Roy —0-761406 21 —0:877795 Rə 0-696086 | 11. —&S,, 
ER, ho; Check 
os, 2187528 
— 1-274996 oy 4-234602 
ー 2-139271 一 2.466279 a 1.955744 
Bos --1:226739 81 — 1-768323 523 — 1-955744 B,, 1 
R 十 0・641349 R} — 0-924493 32 —1:022478 R 0-522808 
ZB; 
500 — 1-192537 
0.108143 a, 一 0.359171 
510  1:300680 b, — 0-359171 
Eb, dA 
— 0-285478 —0-329116 a, 0-260987 
boo 1-015202 521 — 0-688287 bə  0:260987 
Eb, の 
— 0-091307 +0°131618 土 0・145568 a, — 0-074431 
530 0.923895 b, 一 0-556669 b}, --0-406555 5 —0-074431 
b, bys 
j=0 
p Xoo Xo1 Xoz Xos 
0 1-492537 
+ 0-097844. — 0-324967 
1 1-590381 — 0-324967 
4- 0-832856 4- 0-960167 — 0-761406 
2 2-423237 + 0-635200 — 0-761406 
4- 0-786768 — 1-134112 — 1-254314 + 0-641349 
3 3-210005 — 0-498912 — 2-015720 + 0-641349 
Check Pir Xik 


7.2 ORTHOGONAL POLYNOMIALS 167 


7.2.3 


using the coefficients B, 


Zy? 1-218016 


Mao & 0-952837 
Zvj 0-265179 


de, 0-987264 Pos 1-465644 M, 0:7990 Co 4-123638 
a0 1:473528 og 2-187528 a, 1-192537 c 6-154684 


683 
G12 1-465644 du, 4-364756 M, —0-09221 C, 6-927184 | .4, a, 0-119525 
0-297255 0-441291 0-240571 1-241586 | Ev? 0-145654 
Su 1.168389 Sp, 3-923465 .4, —0-332781 ©, 5-685598 | (s,) 
aa 1261044 œ 4-234602 a, —0-359171 c, 6-136476 
475 
Ger 4364756 oq 9-916960 M, 1.132633 C. 17-867257 | M,a, 0-097853 
1-454761 2-159667 1-177349 6-076296 | es 0-047801 
1-473390 4-947662 — 0-419651 7.169789 (s。)  0-02733 
S,,1:436605 S. 2-809631 4. 0-374935 €, 4-621172 
G22 1 oas 1-955744 a, 0260987 c, 3-216731 
731 


12, Enter s, 27.228118 M, 0-929550 C, 43-905028 | M,a, 0-010597 


° 


13. 1x aos 3-206137 1:747835 9-020574 | Xv? 0037204 
14. 5x ays 16-614313 — 1-409195 24-076245 | (ss) 0.02430 
15. 10 x os 5-494919 0-733277 9-037829 
16. Subtract S, 1-912749 4, — 0-142367 €, 1-770380 
17. 833 ess 1 as — 0-074431 c, 0-925568 
Check 569 
j=1 j= 
Xu X12 Xi X33 
1-079302 
1-079302 
4- 1-106938 — 0-877795 0-696086 
2-186240 — 0-877195 0-696086 
+ 1-634802 4- 1:808071 — 0-924493 | + 1-999705 — 1-022478 | 0-522808 
2-695791 — 1-022478 | 0-522808 


3-821042 4- 0-930276 — 0-924493 
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TABLE 
The abbreviated. Doolitile scheme 


Factors removed: x, 10%, q = 1; y, 10°, r = 2; elements divided by 10*, s = 2 


doo 0-670000 d, 0-201730 Fo 0-987264 d, 1-465644 
0.987264 di. 1-465644 d, 4-364756 

622 4364756 go, 9-916960 

ds, 27-228118 


11 


Boo 1 Soo 9670000 S, 0-201730 S 0.987264 S3 1-465644 
Ro 1-492537 | ago «a 0-301090 a 1473528 oo 2-187528 
Check 


Bo. — 0-301090 B, 1 S, 0.926525 S 1-168389 S, 3-923465 
R,,—0-324967 R,  1.079302|o 1 o,  1:261044 oj 4-234603 
Check 


R 
Boz — 1-093840 B,, —1-261044 


Ba 1 Saa 1436605 Sy, 2-809631 
R —0-761406 Ra —0-877795 Rə 0-696086 |a, 1 css 1.955743 
Check 
B» 1-226739 B,, —1-768325 8。。 一 1.955743 5 1 823 1-912748 
Ry 0-641349 R, —0-924494 R —1:022478 R, 0-522808 | æa, 1 
Check 
bo 1-192537 Check 
bo 1-300680 b, —0-359171 Check 
b»  1:015202 b, —0:688287 b, 0-260987 Check 
b,, 0-923893 b, — 0-556667 b 0-406557 b, —0-074432 Check 
Xoo Xor Xoz Xoz xu 
Degree 
p 
0 1-492537 
1 1-590381 — 0-324967 1-079302 
2 2-423238 4- 0-635199 — 0-761406 2-186240 
3 3-210005 — 0-498913 — 2-015719 4- 0-641349 3-821046 
Check Epor Xor Check 


Hence 


Xf M, = Xf X ou = S. Sw Big i, 
and so, from (7.2,3c), 
12 Mon a ba k, B... (4b) 
If the values Zw; / are substituted for M; in (45), 
M= D wiy Ty (z;)- (5) 


Hence the quantities 4 occurring in the Doolittle scheme are 
the orthogonal moments. 
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7.2.3a 
using the coefficients B,; 


Mo 
Mı 
M, 
M, 


1 
ao 


M, 
a, 


0-799000 の 。 4123638 
—0-092210 OC, 6-927184 
13132633 C, 17-867257 
0-929550 C, 43-905028 
Sy? 1-218016 
0-799000 €, 4123638 a, M, 0-952837 
1-192537 c。 6-154684 Xv? 0-265179 
683 
—0-332781 €, 5-685598 a, 41 0-119525 
—0-359171 c, 6-136475 Sv? 0-145654 
476 
0-374936 €, 4621172 a, M, 0-097853 
0-260987 c, 3.216731 Leg 0-047801 
730 
—0-142370 €, 1-770379 as M, 0-010597 
—0-074432 c, 0-925568 os 0-037204 
568 


X12 Xi Xss 
— 0-871795 0-696086 

0-930278 — 0-924494 2-695790 一 1.022478 | 0-522808 
Edi Xak Check Eón Xax Eds Xsk 


7. 2.3 Example 

The various forms of the Doolittle scheme can be extended to include the 
calculations of the quantities B;;. Table 7.2.3 shows the calculations for 
the full Doolittle scheme. The B,; are evaluated from the relation (7.2,3b) 
in the triangular region at the left of the scheme. The instructions are the 
same as for the forward scheme, and the calculations may be done at the 
same time. It should be noted, however, that the two sections are com- 
pletely separate; thus in line 14, products ais Si do not occur. The check- 
ing of the B, is also done separately. If the quantities Ri, = B;,fS;; are 
formed for use in later standard deviation calculations, the values may be 


checked by evaluating 
E Rupo = O, k>0. (1a) 
j 


Otherwise the equation > Bix dos = 9 (Ib) 
3 


may be used. The proof of these two equations is given in $ 7.3.1. 
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The back section of the Doolittle scheme is replaced by a, scheme using 
the values 8% in which the coefficients b,, for all values of the degree p 
from 0 to 3 are obtained. 

The lowest section of Table 7.2.3 contains the calculations for the elements 
xix of the inverse matrices. These calculations are discussed in § 7.3.4. 

The abbreviated Doolittle scheme can be modified in exactly the same 
way. The scheme is shown in Table 7.2.3a. There is no advantage in 
calculating the quantities Bj, at the same time as the forward section of the 
Doolittle scheme, and the calculations of the B;, may be left till the forward 
section is completed. The lowest section of the table gives the calculations 
for the inverse matrices. 


7.2.4 The square root method 
In the square root method a quantity 


81% = a Skk = Si Sky, (1) 
replaces o, and S,,. Similarly, a quantity 
rg BAE = 853 Fg (2) 


will replace the quantities B and R. 
The equation (7.2,3a) relating o; and fy; becomes 
j j j 
> zeg = D (un Sex) (55) = D Sie n = Spm (3) 
k=m k=m k=m š 
The equation for tim is then 
j-1 
Tim = — s ms. (4) 
k=m 
The equation (7.2.2,3), 
> 
by; = P ax, 
for the power-series coefficients becomes 
2 
b; = Zu My. (5) 
The orthogonal polynomial 77(x) is 
T,(z) = EZB,;z* = „ >r; , 
: : 
and so NU raat) = 8 が 2 5 (z) = 1. 


The polynomials Lr a are then the orthogonal polynomials for 
which the arbitrary constants are chosen so that the weighted 
sums of the squares of the values at the points of observation 
are unity. 
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7.2.4.1 Example 


The calculations of % and ba for the previous example are shown in 
Table 7.2.4. The rj, are formed in a triangular array at the left of the 


scheme. 
The formation of the rj} may be checked by the equation 


Er, Po; = O, (1) 


which is obtained by substituting r,; for 8% in (7.2.3,1b). 
'The lowest section gives the elements of the inverse matrices for different 
values of p ($ 7.3.4.1). 


7.2.4.2 Orthogonal polynomials with high-speed computers. When 
an automatic computer is available, it becomes feasible to calcu- 
late the orthogonal polynomials 


$š 
t(x) = Doe ak (1) 


at each point of observation, and thence to obtain the fitted 
curve in the form 


uz) = Dajte), (2a) 
where a; = > 207 yt (z), (2b) 


the sum Zw; tẸ?(x;) being unity. | 
Im the scheme developed by Davis and Rabinowitz (1954), 
¿,(z) is calculated from the inverse of (1), 


j 
xi = Y 83, t,(z), 
k=0 


: ed 
that is, t(x) = 2 ー 2 Š;k ea) / Sjj» (3a) 
k=0 

j-1 
where 8j; Nur — > st, (36) 
z i k=0 
and sr = DW, zi tz). (3c) 
i 


The calculation of the orthogonal polynomials by means of the 
equations (3a—c) is often referred to as the Gram-Schmidt ortho- 
normalization process. Some detailed applications of this process 
to various problems, using the SEAC computer at the National 
Bureau of Standards, are given in the reference cited. 

An alternative method of calculating the orthogonal poly- 
nomials with a high-speed computer is described in § 7.2.6. 
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TABLE 
The square root scheme 


Factors removed: z, 10*, 9 = 1; y, 107, + = 2; elements divided by 10*, s = 2 


0-201730 0-987264 
0-987264 1:465644 


0-670000 


4-364756 

1.221695 | 0-818535 0-246453 1-206135 

— 0-312801 1-038894 | 0-962562 1-213832 

— 0-912610 — 1-052110 0-834317 1-198585 
0-886998 — 1-278590 — 1-414108 0-723054 | 

Degree 570 boy bs bs 

1-192538 
1-300681 — 0359171 
1-015204 — 0-688285 0-260986 
0-923896 — 0-556667 0-406554 — 0-074431 


Xoo Xo1 Xo2 Xos 


g 
Wawas w N m OX 


1-492539 

1-590383 — 0-324967 

2-423240 + 0-635199 — 0-761406 

3-210006 — 0-498908 — 2:015717 + 0.641347 


7.2.5 The use of residuals as a check on the arithmetical calculations 
The residuals v; are the quantities 


の 
Vi = y;— ux) = y— Ca, T;(x;). (1) 
Now, from (7.2.2,4b) and (7.2.2,5), 


and so, using this equation and the orthogonal property, Dw; v? 
can be reduced to the forms 


D 
Leo vr = Naur % La, A,; (3a) 
j=0 
2 
j=0 


D 
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7.2.4 


using the coefficients Tig 


1-465644 0-799000 4-123638 
4-364756  —0-092210 6927184 
9-916960 1-132633 17.867257 
27.228118 — 0-929550 43.905028 

Xy? 1-218016 
1.790570 0-976134 5037827 Sv? 0-265178 
4-076064  —0-345724 — 5-906733 Xo? 0-145653 
2.344126 0-312814 3-855526 os 0-047800 
1-383023  — 0-102940 1-280084 Xv? 0-037203 


X11 X12 13 X22 X23 X33 
1-079301 
2-186236 — 0-877793 0-696085 
3-821029 十 0.930271 — 0-924490 2-695786 — 1-022476 | 0-522807 


The form (3a) is that used in the Doolittle calculating schemes. 
A fourth form 


p 
Zw, v? = の, 一 > bp M, (3d) 
j=0 
follows from the identity 
b M. = Ya, (4) 
= . = a. k 
ime pI $ ine j $ 


This identity is verified by noting that each side is equal to 
Dw; /t u (vt); for 


È Wi Ys un (r. = E wy; >b, a = Zx, La, T(x). 
i 2 1 J 


If the residuals are also calculated by evaluating y; — unt) for 
all points of observation z;, the agreement of the values for 
Lo v: obtained by direct calculation and by use of (3a) will 
provide an excellent check on the arithmetical calculations. 
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7.2.5.1 Example 

A suggested method of calculating the fitted values and residuals is 
shown in Table 7.2.5. The calculations are for the 20 points of Table 7.1.1a. 
The values 6,; are entered at the top of the columns from Table 7.1.8 or 
Table 7.2.3. The entries in the columns are the products of b,, and the 
values 2? given in Table 7.1.1a. As a check, each column is summed and the 
sum compared with the product of , and the value Ca; these should agree 
except for rounding-off errors. 


TABLE 7.2.5 
Calculation of residuals 
bs; 0924 — 05567 + 04066 一 0.07443 
bso x$ bar v; bsa zi baa 好 us (2,) Ug; 
0.924 一 1-648 + 3-562 一 1-930 0.908 +0-172 
一 1-579 + 3-270 ー 1-698 0.917 +0-103 
— 1-501 + 2-955 ー 1-459 0919 +0-111 
— 1-436 + 2-704 — 1277 0915 —0-175 
一 1-423 ＋ 2656 — 1-243 0.914 — 0-664 
一 1:355 + 2-409 一 1-073 0.905  --0-125 
— 1:285 + 2-168 — 0-916 0.891 +0-149 
— 1-081 + 1-532 — 0-544 0.831 —0171 
— 0-957 + 1-202 — 0-378 0-791 — 0-441 
— 0-926 + 1:126 ー 0-343 0.781 +0-949 
— 0-879 + 1-014 — 0-293 0.766  --0-084 
一 0.877 + 1:009 一 0.291 0.765 +0-065 
— 0-801 + 0-842 — 0-222 0.743 —0-053 
— 0-797 + 0-834 — 0-219 0.742  --0:388 
一 0-778 + 0-795 — 0:203 0.738 — 0-288 
一 0-698 + 0-639 一 0-147 0-718 — 0-038 
— 0-640 + 0-537 — 0113 0708 +0-172 
— 0-590 + 0-457 — 0-089 0.702  — 0:132 
— 0:512 + 0:343 — 0-058 0.697 一 0-117 
ー 0-509 + 0:340 — 0-057 0-698 +0-092 
Sum 18-480 — 20-272 30-394 — 12:553 16-049 0-331 
Check 


The rows of values b,; zj are summed to give the fitted values u,(z,). If 
there are no mistakes, Y u,(z;) should be identical with 
1 


い foss の at. 


The residuals v; are next calculated by subtracting the fitted values 
u,(x;) from the original observations y; These are checked by summing 
the v; column and using the identity 


Ev, = Xy,— Nu, (v.), 


Dy, being obtained from Table 7.1.1a. 

The residuals are calculated in a similar way for the two other sub-groups 
into which the observations were divided. The final sum Dv, for the full 
set of observations should be zero, except for rounding-off errors. In the 
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present example a value — 0:012 is obtained. The sum of the squares of 
the residuals is then formed. The value 3-720544 agrees very well with the 
value 0-037204 x 10? given in Table 7.1.8 by use of (7.2.5,3a). Hence it 
seems reasonably certain that no arithmetical mistakes have been made. 


7.2.6 Recurrence relations 


Consider the sums 
È w; T,(z;) x; T;(x;) (1) 
t 


for a fixed value of j. The product zT,(z) can be expressed as 
the sum of polynomials T,(z) of degrees up to k+1. Hence when 
ん <7 一 1, the sum (1) vanishes because of the orthogonal property. 
Also zT;(z) can be expressed in terms of the polynomials T (x) of 
degrees up to 7+1, and so (1) vanishes when k>j+1. Thus 
and so the expansion of zT;(x) in terms of orthogonal polynomials 
must be of the form 

zT(z) = Ty s (2) +=; T(2) + p; T; (2). (2a) 


This gives a recurrence equation for the orthogonal polynomials 


of the form 
Tj (z) = xT;,(x) — 7; T(x) — p; T; (2). (25) 


To find n, (2a) is multiplied by w, 7j(x,;) for each value z = x; 
and the products summed, giving 
T; = EW; Z, T3(x,)/2nw; T3(2). (3) 
Similarly, multiplication by . 7; ,(x;) leads to the equation 
Zw, T;(x;) £i T, ,(x;) = pew; T3 (v). 
But the left-hand side of this equation is 
Ew; T;(x;) lx. T;-1(%;)] = Lu; Ti (z), 
and so p; = Ew; T(z;)|Zw; T3. (z). (4) 
A recurrence relation for the coefficients B,; can be established 
by substituting T (x) = Zr zF in (2b) and equating corresponding 
powers of z on each side. It is found that 
Bia, j+1 = Bx; n, Bx, y P34 チュ (5) 
When a high-speed computer is used, the recurrence relation 
(2b) enables the orthogonal polynomials to be calculated at each 
point of observation. Forsythe (1957) has given a discussion of this 


method. He also recommends in this case that the variable z should 
be re-scaled so that the values æ, cover the range +2 to — 2. 
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It is shown in § 7.7.3 that for equally-spaced observations of 
equal weight po; is approximately n?/16 when æ, covers the 
range +4(n—1) to —i(»n—1). Since Tj(x) varies as 2? when the 
scale of x is changed, p; will, from (4), vary as zx? and so p; will 
be close to unity when x; covers the range +2 to —2. The re- 
scaling will then ensure that 7;(x) and 7; ,(x) will be of the same 
order of magnitude. 


7.3 MATRIX NOTATION 


The solution of the normal equations by the Doolittle method 
can be considered in terms of the factorization into two triangular 
matrices of the square matrix whose elements are ¢,,. If 中 is the 
(p+1)x(p+1) matrix whose elements are %, b and M the 
column vectors whose elements are b, and M, then the quantities 


D Pr bpi 
are just the terms of the product 中 b, and so the normal equations 
(7.1,3) are 中 b = M. (1) 


The symbol S denotes the lower triangular matrix with ele- 
ments S,,72g, and zeros above the principal diagonal, S, = O, 
r «g; and the symbol æ denotes the upper triangular matrix with 
elements a,,,qg<k, and zeros below the principal diagonal, 
xax = , G k. That is 


So 0 0 ... Xoo Xor oz 
S — S1o Su 0 eee ， e m 0 O41 * 


Sy Sap Sos ~ 0 0 anz 
Then (7.1.2,6a) and (7.1.2,6b) give 


k,r p 
Prk = > Bos Oak = p> Bia ks 
q=0 q=0 


i.e. Ó = Se. (2) 


Thus the Doolittle process effectively factorizes 中 into two tri- 
angular matrices S and a. 
Similarly, (7.1.2,6c) is 


M, = S, aas, 
q=0 
i.e. M = Sa. (3) 
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Then, from (1), 


Sab — Sa 
or cb = a, (4) 
which is just (7.1.2,8). If the solution of these equations is 
written b = Ba, (5) 
then ap — I, (6) 


where I is the unit matrix. These are (7.2.2,3) and (7.2,3a-d) 
respectively. Since, when j 2 m, 
p 
22 ji By = Sn 
k=j 
it follows by taking in turn j = p,p—1,...,m+1,m, that 
Pom 85 1. pn 8,41. m 


all vanish and mm = 1. Hence Bym is an upper triangular matrix. 


7.3.1 The check column 
If iis a unit column vector, the check elements C constitute a 


column vector € = $i M. (1) 


Hence, as € is operated on to give cin the same way as M is 
operated on to give a, from (7.3,3), 


Sc = C, 
or e = S-1bi+S-1M = ai +a. (2) 
This is just (7.1.6,3). Similarly, the elements da, form a vector 
d= ale ira =i+b, (3) 


which is (7.1.6,5). 
The formulae (7.2.3,1) used for checking the calculation of 
Bj,, and Ry; are established from the equation 


Sa = ch, 

or S = 8. 

Since Š is a lower triangular matrix, 
2 Pir Poi Sox = O, k»0, 


and, on dividing by 8;;, 
D Ke, Poj = 0. 


These are (7.2.3,1b) and (7.2.3,1a). 


13 
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7.3.2 The square root method 
The quantities % form a lower triangular matrix. From 


2 
(7.1.5,2a), お = ss”, (1) 
where sT is the transpose of s, an upper triangular matrix obtained 
by interchanging the rows and columns of s, so that % = sÉ. 

Equation (7.1.5,2c) gives 
M = sm, (2) 


and so the normal equations become 
s?b = m, (3) 
which is (7.1.5,2d). 


7.3.3 The inverse matrix 
The matrix which is the inverse of 中 will be denoted by x, 


x= 中 一 . (1) 


If the inverse matrix is known, the coefficients b,; are given 
directly in terms of the moments by the equations 


Dp 
b. = M. 2 
pi P» k (2) 


Hence if à number of curves with the same values of z; are to be 
fitted, it may be an advantage to calculate the inverse matrix. 
The inverse matrix may also be useful in standard error 
calculations. 


7.3.4 Calculation of the inverse matriz from the values By; 
The inverse of the matrix « is B. If the inverse of S is denoted 
by R, so that RS — I, (1) 


then ZR, Siem = Sin: 
Now for the symmetrical normal equations, 


Siem = Onk — 


and so Tam Rx Emm = 9 
But Loan x Bx —- es 


Hence the elements of R are readily calculated (see Tables 7.2.3 
and 7.2.3a). 
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The inverse matrix is 
x= 中 = 以 一 S = BR, (3a) 


p p 
or Xjk 一 > Bp Rok = > Boa (35) 
q=0 q=j,k 
the lower limit being the larger of the two values j and k. 


7.3.4.1 Example 

The values R were calculated in Tables 7.2.3 and 7.2.3a. The lowest 
section of Table 7.2.3 shows the calculations of the inverse matrices for 
various values of p, and Table 7.2.3a shows the abbreviated form of this 
calculation. The matrices are symmetrical, and only the elements in the 
upper half are shown. The elements are formed by adding B,, Rpr to the 
element in the matrix of lower degree. 

The arithmetical calculations should be checked by forming the sums 

G Xir for j = O, I, 2, 3. The values should be unity in each case. 


When the calculations are done by the square root method, 
Xn = Nas Tar (1) 


The calculation of the inverse matrices for the square root scheme is 
shown at the bottom of Table 7.2.4. 


7.3.5 Calculation of the inverse matriz from the values oy; 

The elements of the inverse matrix can also be calculated 
directly from the equation 

«X — ., (1) 
although the formulae and the arithmetical calculations are much 
more complicated than in § 7.3.4. From (7.3.4, 2), R = S! is a 
lower triangular matrix and so, when k <j, 
Si 9,4875. 

Hence when k<j, 


Dp 
21 Cum Xmj 一 8; S3, 
m=k 


p 
or Xkj > x; S; — 2 m Xmj* (2) 
k+1 


Thus the values y,; can be built up in turn from the previously 
calculated values x: m > k. 


7.3.5.1 Example 

Table 7.3.5 shows the calculation of the inverse matrix using the values 
of o from the Doolittle scheme of Table 7.1.8. In each section the calcula- 
tions start from right of the page. For example, xis and y,, are entered 
using the previously calculated values xs, and xy,,; Xu and then yı are 
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worked out as shown. The caleulations are checked by the equation 


Z Xir Por = 1. 


This scheme is more complicated than that of $ 7.3.4, but does not use 
the quantities 8%. However, since the calculation of the quantities only 
requires a few extra minutes, it is considered preferable to use the scheme 


of $ 7.3.4 because the possibility of error is much smaller. 


TABLE 7.3.5 


x a 
x N 
* — Qj 

X30 
Check 2 
X . 
x ー jo 


X a 


20 
Check m Piz 


X — 0s 
X — Qj? 
x 一 Qi 
10 
Check 
Soo 
X — Qos 
x — oe 
X 一 aol 


00 


Check 


The inverse matrix using the coefficients wy; 


— 1-143657 
+ 1-506651 
+ 0-278356 
+ 0-641350 


xai の js 


+ 2-236701 
— 3-972326 
— 0-280097 
— 2-015722 


+ 2-022354 
— 1-370791 
— 1-150477 
— 0-498914 


X13 6571 


1-492537 
— 1-402971 
4- 2-970223 
4- 0-150218 
4- 3-210007 


Xos Pio 


X21 


一 工 
Si 


X11 


Xor 


— 2-213884 
4- 1-289391 
— 0-924493 


+ 4-329792 


— 3-399514 xəs 十 2.695793 


+ 0-930278 


1-079302 
十 3.914860 
—1:173121 
+ 3-821041 


— 0-498914 


7.3.6 The omission of observations 


It is occasionally of interest to determine what changes would 
be brought about by the omission of one or more of the series of 
observations. Plackett (1950) has developed formulae giving the 
coefficients and the inverse matrix in terms of the corresponding 


quantities for the full series of observations. 


Xi; 十 0.930278 


ざ = 
—1:022479 33 0-522808 


Xss 一 1.022479 


ー 0-924493 


+ 0-641350 


These formulae 


require the inverse of a r* matrix, where r is the number of 
observations dropped, and so are only useful when r is small. 
If r is greater than 2 it is probably simplest to recompute ¢,, 
and M. and carry out the calculations afresh using the Doolittle 


scheme. 
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A double prime superscript will be used for quantities relating 
to the r observations which are to be dropped, and a single prime 
superscript will be used for quantities relating to the new curve 
fitted to the remaining 2? —r observations. For example, the new 


matrix 中 18 ch = , 


where X" is the p+ 1 x+ matrix whose elements are t and W“ 
is the r xr matrix whose elements are w;. The elements of the 
product X"W"X'" are Xw;z;/z;*. The formulae for the new 
polynomial coefficients, inverse matrix, and sum of the squares 
of the residuals are 


b’ = b—xX”6Gv”, (la) 

X —-XTxX'GX'7TYX, (15) 

and vTW'y' 2vTWv—v'T Gv’, (1c) 
where G is the r xr matrix defined by 

G = W'u—X'7?«4x"w")-1, (1d) 


The proof of these results will be deferred to $ 7.3.6.2. 
If only one observation is to be omitted, G is the single quantity 


G = - Lr az"), (2a) 
If two observations are to be omitted, the elements of G are 
Gu = U EXyaa ED, G, = wi wg EEx 21 2%/D, (2b) 
Gay = Wy Wy ZXygmimz[D, G = w;(1-—w;ZXXy;czjz)|D, (2c) 
where 
D = (1 — wt XV 1) (1 — wy ZXx 25) zç) 
— Wy ty (Z2x; A zy). (2d) 


The following forms of (la) to (lc) are suitable for purposes of 
calculation : 


b; = b; a > (Zxix z£) (Elim Vm) ; (3a) 

Xik = Xjk + > (2x5, 2$) (CG Lxxr 2"); (35) 

Zw; v;? a zw; vi E 2: Vil Gim Ün) (3c) 
7 


7.3.6.1 Example 

Table 7.3.6 shows the calculation of the inverse matrix and polynomial 
coefficients when the two observations at x = + 16:64 and z = + 25-56 are 
omitted from Example 7.1.1.1. It is necessary to restore the factor 10-* to 
the elements xi in Table 7.2.3a. 
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As a check on the calculations, the values of the moments 
My = M ,— >£ xi’ (1) 


are calculated. The values 
b; = Ey; Mh (2) 


should agree with those given by (7.3.6,3a). 


7.3.6.2 Derivation of equations. The new matrix is 


0-90-X'W'X'7, (1) 
Now (I-X'7yX"W')X'7 xX N- ) X- 
" (I- X" xX" W")X"Ty' = X'7x, (2) 
and so, if G = W'(I-X'74X"W"y3, (3) 


then xX”GX”7y = xX”W”X”T x am X( 中 xc o) x = x X x (4) 


which is (7.3.6,15). 
The moments are connected by the equation 


ob = cb X"W^y". (5) 
By use of (1) and (5), 
(I- X'7 xX"W") (y - X"? b^) = y' X bb 
—X'T -X'"xy($ —$')b', 


or (I—X"7 4X"W") (y" „ b’) = y. -— T5 == v. (6) 
and so 

xX" Gv" = W X b“) = x(bb— $'b^) - x($— ch“) b’, 
or xX" Gv" = b—b', (7) 


which is (7.3.6, Ia). 
The equation (7.2.5,3d) for the sum of the squares of the 
residuals is 


v7 Wv = yT Wy - b ob. (8a) 
The new sum will be given by the similar form 
マダ W'y' m yT W'y'—b'7T o’b’, (8b) 
and so 
v W'v' = vT Wy — yT W"y" —b'7 bb” + b? bb. (8c) 


Now, using (6), 
v^T Gv” = ( XT b)" W”(y” — X”7' b”) 
= y"? W'y' —b7($b— $'b’) — (bb — Gb) b. 
br S-) b' 
= y W”y”— b? bb +b'7 ꝙb', 
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and so vTW'v'z v *Wv-v'" Gv’, 


which is (7.3.6,1c). 

7.3.6.3 The fitted values at the omitted points. If v" denotes the 
residuals at the points which are to be omitted and u' denotes 
the new fitted values at these points, then, from (7.3.6.2,6), 


uw = y'— W”-1Gv”. (1) 


The most important case is that in which only one observation z, 
is omitted. The new value u; then gives the fitted value at 2; as 
determined from all the observations except the one at mæ. 


Dropping the double prime superscript, (1) becomes in this case 
uj = V. vi — w EEx VF). (2a) 


TABLE 7.3.6 
The omission of two observations from Example 7.1.1.1 


(7.3.6,3a) b; 


(ちょ Dar) 
EG, (Xx; x") 


(7.3.6,30) Xir 


(7.3.6,3c) Ew 


+ 0-923893 

+ 0-03210005 
— 0-00498913 
— 0-02015719 
+ 0-00641349 


1 

1 
— 0-00246524 
— 0-00524491 
+ 0-06951540 
+ 003327358 


— 0-556667 


+ 0-03821046 
+ 0-00930278 
— 0-00924494 


+ 1-664 
+ 2-556 
+ 0-04175597 
— 0-00092531 
+ 0-03327358 
4- 0-10605348 


+ 0-406557 


+ 0-02695790 
— 0-01022478 


+ 2-768896 
+ 6-533136 
+ 0-02285617 
+ 0-00899985 


0-930485 x 0-893947 — 0-001107 — 0-830697 


+ 1:076141 
+ 0-040055 


+ 0-949628 
十 0.995328 
+ 0-922644 


— 0-00286303 
— 0-00597371 
+ 003213844 
— 0-00510315 
— 0-02027639 
+ 0-00643163 


4- 0:040055 
+ 1-120126 


— 0-664227 
— 0-705981 
— 0-598881 


+ 0-04489825 
4- 0-00063607 


4- 0-04008464 
4- 0-01033471 
— 0-00983521 


4- 0-390161 


+ 002495695 
4- 0-01099647 


+ 002762739 
— 001051792 


3-720544 — 1-414123 = 2-306421 


+ 79-9000 
T1573 

+ 77-9200 
+ 0-922645 


— 9-2210 
+ 0-25 


— 12-7387 


— 0-598883 


+ 113-2633 
+ 106-8398 


4- 0-390160 


— 0-074432 


+ 0-00522808 


+ 4-607443 

+ 16-698696 
一 0.01319336 
十 0.00328566 


— 0-058981 


— 0-01406631 
+ 0-00315189 


+ 0-00542402 


+ 92-9550 


+ 80-8094 
— 0-058980 
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Cohen (1956) has used this result in discussing the estimation of 
the best values for the atomic constants. The form he uses is 


, _ w Vary — Yı Var U 
d var / — VAT U; 
It is shown in § 8.1 that 


varu, = o? Lx, ti f, 


(25) 


and so (2a) and (25) are equivalent. 


7.4 CHANGES OF ORIGIN 


It is occasionally necessary to change from the variable x to a 
new variable with a different origin. Suppose that the new 
variable has its origin at z = g, 


z = z—g. (1) 
The fitted curve will be written 
2 
% (z) = pd (2) 


The relation between the coefficients b,; and Cy; is found from 
the equation 


1 % = X, (z gy. 


Thus Cpj = > ( 95 (3) 
q-iM 
Alternatively, the coefficients c, may be expressed in terms of 
the orthogonal coefficients a; in the form 


p 
Cog = È Yik ar. ‘ (4) 
Then, using (3), 


cos = E) È bum X x (4) e Baran 


q=j 一 q=j\J 
Ë (d 
and so Yn = > ( ) 97-4 Par (5) 
q=5\J 


The y; are useful in the evaluation of the standard deviations 
of the c. If these standard deviations are not required, the 
coefficients c, can be obtained from the b%, by (3). Table 7.4 
gives the explicit formulae for polynomials up to the fifth degree. 
It will be observed from (5) that the formulae for % in terms of 


B; are also of the form shown in Table 7.4. 
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TABLE 7.4 


Relation between the power-series coefficients b and c 


co = by + 951 ＋ g?b,-- 955 ＋ g*b,-- gb; 


cl = b, +2gb, 4-3g?b, + 495, 595 
Cs = b, +3gb, + 6g°b, 十 1093D5 
ca = b, +4gb, 十 1092D5 
c, = b, + 5955 
cpm b; 


7.4.1 Example 


Table 7.4.1 shows the detailed calculations when the origin in the scheme 
of Table 7.2.3 is transferred to the point z = —2. This corresponds to & 
change of origin to a temperature of 0? C. in the original data. 

Section (a) shows the evaluation of the ca, directly from the b,. This is 
the most rapid method when these coefficients only are required. If coeffi- 
cients of polynomials of lower degree, or elements of the inverse matrix, 
are to be obtained, the values %% and Qg; = V may be evaluated first, 
as in section (b) of the table. In the scheme shown all the intermediate 
products have been written down, but the scheme may be abbreviated by 
accumulating these intermediate products in the register of the calculating 
machine and not recording them separately. The coefficients are then 
caleulated as in section (c) of the table. 

The scales of the variables used in the illustrative schemes differ from the 
original variables x and y by the factors listed in Table 7.1.8. Hence, 
from § 7.1.7, if ¢ is the temperature (= z+ 20), 


Uy = X107 10-25 C» Ü, 
where g = 1,r— 2. Thus 
wu, = X10?(1077c,;) t! 
= 425-89 — 30-761: + 0-853141? — 0-0074432, 


and J, = 4-17 4- 10-4 u. 


7.5 ITERATIVE METHODS FOR THE SOLUTION 
OF THE NORMAL EQUATIONS 


When the number of unknowns is large, it may be preferable to 
solve the normal equations by iterative procedures. "This is 
specially true if high-speed automatic calculating machinery is 
being used, since repetitive processes are easily programmed on 
such machines. When desk calculators are being used, the two 
methods given below may be of advantage in certain cases; for 
example, when each unknown occurs in only a few of the normal 
equations. 
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TABLE 7.4.1 


Change of origin 


(a) Evaluation of c,; 
g =—2 
530 十 0.923895 b,, 一 0.556669 bza +0-406555 bss — 0-074431 


1 +0-923895 g + 1-113338 g? 十 1.626220 g? 十 0.595448 + 4-258901 
1 —0-556669 2g — 1-626220 3g? — 0-893172 — 3-076061 
1 --0-406555 3g +0-446586 + 0-853141 


x XXX 


1 —0-074431 — 0-074431 


Check  €eg,(—g)! = bzo 


(b) Evaluation of yzg 
ga =5 


Qoo + 1-492537 


801 — 0-301090 —S,, 0-926525 
x|1 一 0-301090 s — 2-301090 10 — 2-483570 
x 1 Q,ı +1:079302 


802 — 1:093840 — 1-261044 +S, 1-436605 
1 21093840 + 2-522088 Yoa + 5-428248 220 十 3.778525 
一 1.261044 X yi» 一 5.261044 Q, — 3-662137 
722 1 Qaa + 0-696086 

EQ —9) = Bos/Ss, = Roy 


XXX 


Bos 十 1.226739 一 1.768323 f,, 一 1.955744 B, 1 833 1912749 
1 41226739 ＋ 3.536646 g? — 7.822976 g? 一 8 yo, — 11.059591 Qs, —5-782040 
— 1.768323 29 +7-822976 3g? 12 | yis 118054653 Qz, 9439113 
— 1.955744 39 6 yo, — 7.955744 Q 4159325 
1 11728 1 Qss + 0-022808 

Check EQs;( — 9)! = Bos/Sss = Rso 


X X X X 


(c) Evaluation of , using the values % 


ao 1・192537 
701 al 40-826485 41 — 0-359171 
10 2-019022 c,  — 0-359171 


yoz as --1-416702 1 4½ —1-373064 a, 70260987 
cso +3-435724 cə —— 1.782230 c, 十 0.260987 


2 
Check Tor, (—g) = > Bos a, = bzo 


yosas 十 0.823176 913 4 — 1-343826 yaş +0-592154 a, —0-074431 
Cso 44.258900 cg,  — 3-076061 c, 70853141 oc。。 一 0.074431 
Check Eca; (— 9g)? = bzo + Bos as = bso 
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7.5.1 Von Seidel's method 


In von Seidel's method, the value b is determined from the 
jth normal equation, 


b; = Sen bor) | bss (la) 


The earlier approximations 5% are used on the right-hand side. 
The initial approximations by which the process is started are 


usually taken as bpr = Mil prr a») 


The values 5,,,5,,... are corrected in turn, using (la). For 
example, in calculating the second approximation to b,,, the 
second approximation to the values b,, (k<j) and the first 
approximation to the values ó,, (9>J) are used in (la). The 
process is continued till ppp is reached, and then started all over 
again by determining the third approximation to b,,. The itera- 
tive procedure is continued until the desired accuracy is obtained. 


7.5.2 Relaxation method 

The relaxation method (the terminology comes from structural 
engineering) is similar to the von Seidel method, but the coeffi- 
cients are not adjusted in any fixed order, the order being selected 
by the computer. Usually the equation which has the largest 
residual 


p 
R; = M, - En 55 (1) 


will be selected. Hence the residuals are reduced more rapidly 
than in the von Seidel method. 

It is probably best to draw up a systematic scheme, consisting 
of an ‘operations table’ (Table 7.5.2) and a ‘relaxation table’ 
(Table 7.5.2a). Line j in the operations table gives the decreases 
in the residuals for a change in Ab; of one unit. Hence when a 
change Ab; is made in the relaxation table, the residuals are 
reduced by Ab; times the factors in line j of the operations table. 


TABLE 7.5.2 


Operations table for three variables 


188 POLYNOMIALS AND OTHER CURVES 
TABLE 7.5.2a 


Relaxation table for three variables 


Coefficients Residuals 
A. 50 52 69 Rg R3 R9 
B. Ab, (A) —Ab, x (1) 
C. Ab, (B) - Abo x (0) 
ete. ete. 
Add b bi bi Check 


The zero-order approximations b? obtained from (7.5.1,1b) and 
the corresponding residuals E? obtained from (1) are written 
down in line A of the relaxation table. Suppose that A? is the 
largest residual. Then a relaxation Ab, is made in b, so that the 
residual R, is very small. Clearly 


Ab, RAU 


The new residuals are obtained by subtracting from those in 
line A the product of Ab, and line (1) of the operations table. 
If the largest residual is now Ro, a relaxation 


Ab, * R/ doo 


is made, and the new residuals calculated. The relaxations are 
continued, the residuals becoming smaller and smaller. A halt is 
called at a-suitable point, and the corrected values b} obtained 
by summing the columns of the relaxation table. These values 
are then substituted in (1). If the arithmetic is free from mistakes, 
the residuals obtained should agree with those in the last line of 
the relaxation table. Then if necessary the process can be carried 
further until the required accuracy is obtained. 


7.5.2.1 Example 


In Table 7.5. 25 are shown the calculations of the second-degree coefficients 
for the example previously used in this chapter. 

The first section of the table shows the operations table for this case. 
The first line A in the second section shows the initial approximations 
Mi, and the residuals obtained using these approximations. At the 
end of this section the approximations 1-02, — 0-69, +0-26 are obtained. 
The residuals are calculated afresh using these approximations, and the 
procedure carried a stage further in the third section of the table. 

It should be emphasized that such a procedure takes a much longer time 
than the solution by the Doolittle scheme, and it would only be employed 
in exceptional cases. However, iterative schemes are very useful with 
modern automatic computers, where a large number of similar operations 
can be rapidly performed. 
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TABLE 7.5.2b 


Relaxation method for the solution of normal equations 


0-670000 0-201730 0-987264 
0-201730 0-987264 1-465644 
0-987264 1-465644 4-364756 


— 0-2368 — 0-6245 ー 1:0451 
— 0-1097 —0-1217 
— 0-0025 "0: + 0-0363 
— 0-0086 *000: — 0:0077 
— 0-0019 0022 + 00022 


— 1-895 


— 2-339 
— 0-329 
— 0-823 
+ 0-115 
一 0.181 
— 0-100 
4- 0-034 
— 0-065 
+ 0-002 


+0-2609 | +0-0024 +0-0221 T 0-1552 


7.5.8 Group relaxations 


The simple operations of the operations table may be com- 
bined to give more complicated group relaxations, where several 
of the coefficients 5。, are varied simultaneously. The ‘groups’ are 
selected so that the relaxation causes a large change in one 
residual, and very small changes in the other residuals. An 
operations table entry is of the form 


Xo & A ho ty te, 
where (say) yo and ya are very small. The V; are given by 
Jy = Xaj prj- 
If the residual to be reduced is Ri, the relaxations are a,, where 
rı ~ Bs. 


When single relaxations are used, a decrease in R, may lead to an 
increase in R, and R. With group relaxations, R, and R, are 
practically unaffected. 


2x 
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7.5.3.1 Example 

The top portion of Table 7.5.3 shows the method of obtaining group 
relaxations for the example of $ 7.5.2.1. The calculation of the approximate 
solutions is shown in the lower section. 


TABLE 7.5.3 


Solution of normal equations by group relaxations 


01730 0-987264 
87264 1:465644 
65644 4-364756 

0-021386 3-470676 
— 0-053534 2-546092 


0-670000 0-2 
0-9 
l-4 


— 0-481668 0-469264 
1-496148 0-032176 
0-395986 8-093596 


一 0.6245 ー 1-0451 

4- 0-0039 — 1-0316 

— 0-0154 —1-0128 

+0-0321 — 0-0416 

+ 0-0007 — 0.0422 

+ 0-0036 — 0-0450 

+ 0:0060 + 0-0036 

0 + 0-0035 

0-00055 . ・ ` + 0-0003 + 0-0033 
0-000+ -00: *00: . 2 ＋ 0-0001 + 00001 


4-0-000064 — 0-000261 — 0-000278 


7.5.4 The method of steepest descent 

Relaxation methods require the exercise of judgment, and so 
they are not very suitable for automatic computers, where a 
definite programme is desirable. Various iterative methods suit- 
able for such machines have been described by Householder 
(1953) and Booth (1955). One of these methods, called the 
method of steepest descent, will now be briefly outlined. 

The normal equations are in matrix notation 


M-— b = 0, (1) 
and if B is an approximate solution of these equations 

M- B =r, (2) 
where r represents the residuals. The quantity 

S = rT or (3) 


is a function of the B,, and it is always positive except for B = b, 
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when it vanishes. Hence an iterative process can be based on the 
minimizing of this function. The variations of the coefficients B; 
to give new approximations f; which are considered are those of 


the form B; = Bj +Au;, 
or g = B+ u. : (4) 


For a given set u;, the value of À which minimizes S is found 
from the equation 


297A = ten = 0. (5) 
Now r Mg! r- chu, 
and so (5) gives —r7u+dAu? hu = 0, 
or A =r? ufu? ou. (6) 


To find the best set w;, the steepest descent criterion states that 
the values are to be chosen so that the decrease of S is most 
rapid. Now the vector u which gives the most rapid decrease is 
the set u, whose elements are proportional to —@S/é8;. This 
vector corresponds to — grad S in a space of »+1 dimensions. 
Then 


u = — Fe = - gg OM- 68) 6301-69), 
and when this is differentiated it is found that 
u = M- fg = r. 
Hence the method of steepest descent gives for the next approxi- 
mation B’ = B+2r, (Ta) 
where A= fT rit bp = 23 0 * Th Pire (7b) 


The method of steepest descent can also be based on the 
function Rehr 


instead of on the function S, but the formulae are more 
complicated. l 


7.5.4.1 Example 


The steps in the application of the method of steepest descent based on S 
to the example used in this section are shown in Table 7.5.4. Of course this 
example is only intended to illustrate the method, as iterative procedures 
would never be applied when the number of unknowns is so small. 

Starting with the initial approximation 


B; = M;/ の か 
the residuals r, =M,;—XB; $; 
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8861L-lI 
€98906-0 
LL89-1 
980L06-0 
9919-T 
78690c-0 
9669-T 
97010c-0 
Y 


966F1000-0 
198960000 


I99F160:0 
TOFTT00-0 


8149000-0 
88811000 


8716600 
8806100 
88965000 
98505000 


851905 ˙0 
1907800 


991860-0 
898f7F0'0 


IL81I99:; 
988889 · J 
uA WK 


pus ¿q 


SE9GELT 
013360-0 — 


000664˙0 
"Ww 


9F6060:0 + 
029600-0 + 


IZ610€-0 — 
€8L690-0 — 


L668Y0-0 + 
€9800-0 + 
86F969-0 — 
Ie1601-0 — 


968060-0 t 
6L08T0-0 + 


TALIS T — 
069866:0 — 
S86406・0 + 
868601-0 + 


9980146 一 
OPISTO:I— 


OSLP9E-F 
*F9997-I 
F96186:0 


€96800-0 + 
816800-0 — 


€988IT-0 — 
6S81E0-0 — 


8$9800-0 + 
90 了 ん [0.0 — 


6869$6-0 一 
$£96990-0 — 
SP0SI0-0 + 
LPOTPO-0 — 


SP986F-0 一 
89ZFFI-0— 
866F60:0 — 
LPOS8SI:O 一 
8OI96I:¿— 
58fTF59.0 一 
xf 由 tuz 


pur f4 


vY*999y-T 

?964860 

081105•0 
th 


8LZ100-0 + 
808600-0 — 
967940-0 — 
588950·0 一 


5865000 + 
T07060-0 — 


69799T-0 一 
084690:0 — 
011600-0 + 
る 694800 一 
160S68:0 — 
064701-0 — 


813880-0 + 
008430-0 + 


F8P918:I 一 
88898 る ・0 一 


195L86-0 
08L106:0 
000049-0 


quaosap ysadaajs fo poya IT, 
FUL WwISVI 


0196-0 


1993-0 
9910-0 + 
9683-0 + 
6010-0 — 
7093-0 + 
PPEO-O + 
0916-0 + 
9660-0 一 
9886-0 + 
€6L0-0 + 
7991-0 
8150-0 — 
18180 + 
8691-0 
6670-0 
I016-0 — 
96-0 


*660-0 — 
7619-0 — 
L810:0 — 
L809-0 — 
8890-0 — 
6969-0 — 
6660-0 — 
0109-0 — 
S166:0 — 
9918-0 — 


6910:1 


LPEO-T 
6910-0 — 
9190-1 
6900-0 — 
8990・[ 
¥PE0-0 — 
€I60:1 
6010-0 — 
IZ0L-T 
6690-0 — 
0991˙1 
1180-0 一 
L98T-T 
8550-0 ＋ 
PII 
9Ly0:0 — 
61˙1 
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are calculated, and from these in turn 


Dre c · Tr, (Tri G. Uj. 


Then À = D/ Tr, (Ure Six), 
AB, = Ary, 
and the next approximation is 
B; = B, + AB;. 


It is seen that the values B; tend towards the solution 5, It is interesting 
to observe that the quantities in alternate approximations are similar in 
form, as if the descent is following a zigzag path. 


7.6 EQUALLY-SPACED OBSERVATIONS 
OF EQUAL WEIGHT 
When the interval Az between successive observations is constant, 
the calculations are best performed in terms of the variable 
e = ( =- F) / Av. (1) 
The values e; at the points of observation are the integers or half- 
integers from — 1(n— 1) to 十 3(% 一 1). 


7.6.1 The orthogonal polynomials Jae) 
The orthogonal polynomial 7;(e) is related to the powers ek by 
the equations 


Te) = X ye, (1a) 
k=0 
i 
ej = PE TT (e). (15) 
It will now be shown that 
2 0 = (- 2-9. (2a) 


For if (22) holds for all values up to j — 1, then from (7.2,4a—e), 
«y = Ed Tle) E THe) = CC Y** E (= «4 - eJ Te. 
Now the values e; are symmetrical about zero, and so 
> &$T,(e) = > (— €) T.( — €), 
t 
amd a vanishes when j+ is odd. Hence 
T(e) = マー ¥ oy; Tyle), 

itk 

and even 


T,(— e) = (— <) — D ou Nele = (—) [ez — Tax; T,(e)], 


even 


14 


194 POLYNOMIALS AND OTHER CURVES 

and so (2a) follows by induction. Finally, since 
T(—«) = Eile)" = (- Y By, 

By; also vanishes when た 十 7 is odd. 


It is possible to derive formulae for o,;, B and S,, = XT*(e) 
from the values Cet, but these formulae are obtained more 


1 
simply when the orthogonal polynomials are expressed in terms 
of the factorial powers (). The formulae are listed in Table 7.10a 


for polynomials up to the 9th degree. Proof of these formulae 
will be postponed until $7.7. 


7.6.2 Fitting by power moments 

The power moments are simply calculated and, since the values 
e; do not depend on n, the only quantities to be tabulated are 
Bi; and S;;. Then, from (7.2.2,46) and (7.2.2,3), 


M, = Lek Yi, (la) 
and 557 = Y, aN. (1c) 


Values of 8% and S;; for polynomials up to the fifth degree are 
listed in Table 7.105 for »6(1)75. 

When n is even, the values e; are half-integers. It is then 
simplest to calculate M, by means of the equation 

25 M, = X (ec) - y;. 
7 

Hence different calculating schemes are used for the cases when 
n is even (§ 7.6.2.1) and when n is odd (§ 7.6.2.2). 


7.6.2.1 Example—n even 

The calculation of the moments when n is even is done by entering the 
observations in the scheme shown in Table 7.6.2.1. In the present example 
the values y represent changes in sugar prices over a period of 62 years. 
This example was used by Anderson and Houseman (1942), who smoothed 
the values by fitting & cubic curve. 

The observations are entered in the y columns, starting from the lower 
portion of the y, column and entering the values in decreasing order of e. 
The moments M; may then be calculated by summing the products of the 
corresponding values in the columns y and (2e);, 


M, = X(2ef (y €) - Y y( )/27. 


The products for the observations of y corresponding to negative values 
of e are subtracted if j is odd and added if j is even. If the number of 
observations is large it may be convenient to form first the sums and 
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TABLE 7.6.2.1 
Calculation of moments—n even 


M; = Lei(y++(—)Fy-) 


32e5 Se? 2e Diff. y+ y- Sum| 4e? 16e* 
1 1 1 —8 5 13 18 1 1 
243 27 3 —2 6 8 14 9 81 
3125 125 5 +4 10 6 16 25 625 
16807 343 7 +3 8 5 13 49 2401 
59049 729 9 0 10 10 20 81 6561 
161051 1331 11 0 13 13 26 121 14641 
371293 2197 13 +1 10 9 19 169 28561 
759375 3375 15 一 了 3 10 13 225 50625 
1,419857 4913 17 +2 a £ 12 289 83521 


361 130321 


+ 
— 

m 

= 

° 
mo 
t 

ーー 


2,476099 6859 19 


4,084101 9261 21 +27 29 2 31 441 194481 
6,436343 12167 23 + 36 37 1 38 529 279841 
9,765625 15625 25 +30 38 8 46 625 390625 
14,348907 19683 27 +47 50 3 53 729 531441 
20,511149 24389 29 + 68 74 6 80 841 707281 


961 923521 
1089 1,185921 
1225 1,500625 
1369 1,874161 
1521 2,313441 


28,629151 29791 31 0 22 22 44 
39,135393 35937 33 —17 19 36 55 
52,521875 42875 35 T 14 ++ 30 74 
69,343957 50653 3⁄7 十 15 35 20 55 
90,224199 59319 39 —6 15 21 36 


115,856201 68921 41 —9 15 24 39 | 1681 2,825761 
147,008443 79507 43 — 10 18 28 46 | 1849 3,418801 
184,528125 91125 45 — 30 15 45 60 | 2025 4,100625 
229,345007 103823 47 — 42 10 52 62 | 2209 4,879681 


282,475249 117649 49 —51 6 57 63 | 2401 5,764801 


345,025251 132651 51 ー 52 4 56 60 | 2601 6,765201 
418,195493 148877 53 —48 0 48 48 | 2809 7.890481 
503,284375 166375 55 — 52 3 55 58 | 3025 9,150625 
601,692057 185193 57 —'i2 $ 73 74 | 3249 10,556001 
714,924299 205379 59 ー 62 3 65 68 | 3481 12,117361 


3721 13,845841 
3969 15,752961 
4225  17,850625 
4489  20,151121 
4761 22,667121 


844,596301 226981 61 — 60 7 67 74 
992,436543 250047 63 

1160,290625 274625 65 

1350,125107 300763 67 

1564,031349 328509 69 


5041 25,411681 
5329 28,398241 


1804,229351 357911 71 
2073,071593 389017 73 


Sum —270 533 803 1336 


NOTE that the values found by multiplying the columns must be divided 
by 25 to give M,. 
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differences of the observations of equal |e|; this halves the number of 
multiplications. The sums and differences are checked by adding the 
columns, the total of the sums being Ly++ Zy- and the total of the differ- 
ences Xy,.— Xy.. It is advisable to repeat the calculation of the moments 
before proceeding further. 

The coefficients for the third-degree curve are evaluated in Table 7.6.2.1a. 
The values Xv? are for use in calculations of standard deviations (8 8.4) 
and in checking the calculations (S 7.6.2.3). The fitted curve is 


us (e) = 12-378 + 0-9798e + 0-028635e? — 0-0025868e?. 


TABLE 7.6.2.1a 
Evaluation of coefficients—third-degree curve 


Soo 62 

Si 19855-5 

S,, 5.083008 

Sas 1253,143008 

Bus — 320-25 

Bis — 576-25 
a, = .&,JS;, Xy? 54038 aa = b, —0-002586832 
M, = fo +1336 a, 28789 Bis 2s + 1-490662 
ao 十 21.54839 Du 25249 +a, — 05108408 

zb, + 0-979821 

M, = M,— 10143 a1 A1 5181 
a, — 0-5108408 Zv? 20068 a, = by, --0-02863462 
M, + 573404 a Ma 4168 Bos 2 — 9-17024 
^w Mo 一 427854 Evi 15900 十 ao 十 21.54839 
= M, 十 145550 (85) = bpo +12-37815 
as +0-02863462 
M, — 9086574-75 ag M, 8386 
＋ 51 M, --5844903-75 XZ 7514 
= M; — 3241671 (83) 11-38 


as 一 0.002586832 


7.6.2.2 Example—n odd 


The scheme for calculating the moments when n is odd is shown in 
Table 7.6.2.2. The observations are the measurements of the frequencies 
of the first 25 lines in one of the bands of the CuH spectrum (Birge and 
Shea, 1927). The frequencies vary from 22330-52 cm~? to 23295-47 i. 
The constant 22300 is subtracted from each figure before entering it in the 
caleulating scheme. The observations, in contrast to those of Example 
7.6.2.1, are very accurate, and it is necessary to retain a large number of 
figures throughout the calculations. 

The scheme for the evaluation of the coefficients for a curve of the fourth 
or fifth degree is given in Table 7.6.2.2a. In the present example a fourth- 
degree curve is fitted, the curve obtained being 


u (e) = 647-254 + 40-8346 — 0-93435e? — O- 0043 766 + 0-00001383e*. 


100000 


161051 
248832 
371293 
537824 
759375 


1,048576 
1,419857 
1,889568 
2,476099 
3,200000 


4,084101 
5,153632 
6,436343 
7,962624 
9,765625 


11,881376 
14,348907 
17,210368 
20,511149 
24,300000 


28,629151 2 


33,554432 


39,135393 : 


45,435424 
52,521875 


60,466176 
69,343957 


or WON — © 


0 G ~ 


M; 


Diff. 


81-67 
163-32 
244-85 
326-17 
407-25 


488-11 
568-68 
648-88 
728-55 
807-88 


886-74 
964-95 


Le 4- (—)! y-) 
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TABLE 7.6.2.2 


Calculation of moments—n odd 


Sum 


1292-63 
1286-98 
1277-69 
1264-61 
1247-83 


1227-31 
1203-02 
1175-00 
1143-35 
1107-84 


1068-84 
1025-99 


6317-05 10319-07 4002-02 14321-09 
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160000 


194481 
234256 
279841 
331776 
390625 


456976 
531441 
614656 
707281 
810000 


923521 


1,048576 
1,185921 
1,336336 
1,500625 


1,679616 
1,874161 
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TABLE 7.6.2.2a 


Evaluation of coefficients—fourth-degree curve 


Bis 25 Sy, 82,409184 
11 1300 Ba 133 
Soo 33820 Bog — 2059.2 


Ey?  11,133450-4770 


40 4 8,962095-9930 
Leg — 2,171360-4840 


4 Mı 2,124518-8973 
Eoi 46841-5867] a, = bp, +0-0000138302061 


728167-96 a, M, 46800-7296 一 0.001839417 
一 778355-76 X 40-8571 —0-932512077 
A ec m - —0-934351494 
— 0-932512077 
Boa da +0-028479 
4899173-36 40-8198] % a, + 48-490628 
— 4908500-636 0-0373 | +a + 598-7 352 
—9327-276 b. 7.2543 
一 0.00437638931 — — 
66024590-32 ds = bss 
+o, M, —96846338-68 P 
+Bo, Mo +30822888-096 35 48 ” 


+0-0000138302061 一 bos 


Mg 1 Bis gs 


M + Pia Ga + 0-4087548 
+ Bas Ms +a, + 40-4258 


+B, M 55 
Mis d 1 zb + 40:8345548 


Gs 


7.6.2.3 Evaluation of residuals. It is very desirable to check 
the calculations by forming the residuals v; and comparing the 
value £v? with that obtained using formula (7.2.5,3a). 

When n is even (Example 7.6.2.1), the coefficients 5% are 
divided by 2/, and the products (b,,;/2/) (2e;7 are evaluated using 
the columns of values (2e; in Table 7.6.2.1. The sum % of the 
terms containing even powers and the sum u” of the terms 
containing odd powers are evaluated separately in the two 
extreme columns of Table 7.6.2.3a. Two results which are useful 
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TABLE 7.6.2.3a 


Evaluation of residuals—n even 


Odd powers Even powers 
53172 + 0-4899 bzo 12-378 
b34/8 — 0-0003234 b4,/4 0-007159 
2e u” U4 V+ v- u~ w 
1 0:5 12-9 ー 7・9 +1:1 11-9 12-4 
3 1:5 13-9 ー 7-9 — 2-9 10-9 12-4 
5 2-4 15-0 —5-0 — 4-2 10-2 12-6 
7 3:3 16-0 — 8-0 — 44 9-4 12-7 
9 4-2 17-2 一 7.2 +1-2 8:8 13-0 
11 5:0 18-2 —5-2 T48 8-2 13-2 
13 5-7 19-3 — 9:3 +11 7-9 13:6 
15 6-3 20-3 —17:3 + 2-3 7-7 14-0 
17 6-7 21-1 —14-1 一 2.7 7-7 14:4 
19 7-1 22-1 — 6-1 — 2-9 7:9 15-0 
21 7-3 22-8 + 6・2 一 6.2 8-2 15:5 
23 7:3 23-5 十 13-5 ー7・9 8-9 16-2 
25 7-2 24-1 十 13.9 — 1-7 9-7 16-9 
27 6-9 24-5 +25-5 ー77 10-7 17:6 
29 6:3 24-7 + 49-3 — 6-1 12:1 18-4 
31 5-6 24-9 ー2-9 483 13-7 19-3 
33 4:5 24-7 — 57 4- 20-3 15-7 20-2 
35 3-3 24-4 + 19-6 +12-2 17-8 21-1 
37 1-7 23-9 +11-1 — 0-5 20-5 22-2 
39 —0:1 23-2 ー 8-2 — 2-4 23-4 23-3 
41 一 2.2 22-2 ー 7-2 一 2.6 26-6 24-4 
43 —4:6 21-0 — 3-0 -2-2 30-2 25-6 
45 — 7-4 19-5 — 4-5 + 10-7 34-3 26-9 
47 — 10-6 17-6 —7-6 + 13-2 38-8 28-2 
49 —14.0 15-6 — 9-6 +13-4 43-6 29-6 
51 —17-9 13-1 — 9-1 +71 48-9 31-0 
53 — 22-2 10-3 — 10-3 — 6-7 54-7 32-5 
55 — 26-9 7-1 —41 一 5.9 60-9 34-0 
57 — 32-0 3-6 — 2-6 + 5-4 67-6 35-6 
59 — 37-5 —0-2 十 3-2 . 一 9.8 74-8 37-3 
61 — 43-5 — 4-5 +11-5 —15:5 82-5 39-0 
Sums — 126-1 542-0 —9-0 T88 794-2 668-1 
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TABLE 7.6.2.3b 


Evaluation of residuals—n odd 


Odd powers Even powers 


ba 40-834555 540 647-2543 
bas — 000437639 542 — 0-934351 
bas + 0-:00001383 

€ u” U+ va v- u u’ 
0 647-2543 + 0:0357 
1 40-8302 687-1502 — 00002 — 0-0098 605-4898 646-3200 
2 81-6341 725-1512 — 0-0012 — 0-0530 561-8830 643-5171 
3 122-3855 761-2318 +0-0382 — 0-0408 516-4608 638-8463 
4 163-0581 795.3663 +0-0237 — 0-0301 469-2501 632-3082 
5 203-6257 827-5299 + 0-0101 + 0:0115 420-2785 623-9042 
6 244-0620 857.6976 +0-0124 + 0-0264 369-5736 613-6356 
7 284-3408 885-8451 4- 0-0049 + 0-0065 317-1635 601-5043 
8 324-4357 911-9482 — 0-0082 — 0-0168 263-0768 587-5125 
9 364-3206 935-9831 — 0-0331 4- 0-0581 207-3419 571:6625 

10 403-9692 957-9267 — 0-0667 — 0-0083 149-9883 553-9575 

Ji 443-3551 977-7554 ＋ 00346 + 0-0048 91-0452 534-4003 

12 482-4523 995-4468 + 0・0232 — 0-0222 30-5422 512-9945 

Sums 3158-4693 10319-0323 十 0.0377 一 0.0737 4002-0937 7160-5630 


in checking the formation of these columns are 
22 (十 Wo if n odd) = Mp, 
2Xieu" = W. 
Here the first sum is 1336-2 and the second — 10147-1. 

The fitted values u, for < positive are the sums w%'+%”, the 
fitted values u_ for e negative are the differences u - u. As a 
check on the formation of these sums and differences, the columns 
themselves are summed. If no mistakes have been made, Xu, is 
the sum of Lu and £u”, and Lu, the difference of these totals. 

The residuals are now formed by subtracting the fitted values 
from the observed values y;. Again the sums of the columns are 
formed as a, check, using the identity 


Lv = Ly— Lu, 


the value £y being obtained from Table 7.6.2.1. 

If there have been no mistakes, Xv, will be zero, except for 
rounding-off errors. In the present example Xv; is ~0-2. The 
squares of the values v; are then summed, giving a value 7515-44. 
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This compares very well with the value 7514 obtained in Table 
7.6.2.1a, and so the calculations are free from mistakes. 

When % is odd (Example 7.6.2.2), the procedure is similar. 
The calculations are given in Table 7.6.2.35. The % and v values 
for e = 0 are not included in either the + or — columns, but are 
left separate. The checks on the formation of the values w' 


and u” are 2Xw +u, = 14968-3803, 

2 Leu = 52553-5402. 
The sum of the residuals is — 0-0003, and the sum of their squares 
0-02151359. The value given in Table 7.6.2.2a is 0-0215. 


7.6.3 Fitting by orthogonal moments 
If the values 7;(e;) at the points of observation are known, it 
is possible to calculate the orthogonal moments 


XT (Ex) Yi» (1a) 
and hence to find the coefficients a; from the equation 
a; = Mil. (15) 


Although this method is no more rapid than that using power 
moments, at least for polynomials of degree less than 6, cases 
arise in which the use of orthogonal moments may be preferred. 

In general the values T;,(e;) are not integers, while it is clearly 
an advantage both in tabulating and in computing to work with 
integral values. As a consequence, the polynomial usually tabu- 
lated is that multiple of 7;(«) for which the values at the points e; 
are the smallest possible set of integers. These polynomials have 
been denoted by the symbols 与 (e) (Fisher), Ke) (Birge), の (<) 
(van der Reyden), and P, (e) (Milne). Here the symbol T;(e) will 


b d, , , 
aii T;(e) = Bi; Tyle). (2) 
If the fitted polynomial is written 
up(e) = Za; 7(<), (3) 
Hence a; = DPs Ya Tilea) lE Tile) 
or a; = Ly, Tile) ET; le) = Mil Si, (5) 


where A, is the orthogonal moment, which may be calculated 
from tables of T';(e;). 

If the fitted values are required only at the points of observa- 
tion, then only the coefficients a; are needed. If the fitted values 
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are required at other points it is simplest to expand the curve in 
power-series form. The coefficient % is given by 


p 
b; = D Pira (6) 
k-j 
where, from (7.6.2,1c) and (4), 
Pir = B;; Bir (7) 


7.6.3.1 Tables of orthogonal polynomials. Tables of T...] and 
ET;*(e;) have been prepared by various authors. A summary of 
the tables most readily available is given below. 


Author j to n to 
1. van der Reyden (1943) 9 52 
2. Fisher and Yates (1948) 5 75 
3. Biometrika Tables (1954) 6 52 
4. Anderson and Houseman (1942) 5 104 
5. Birge (1947) 5 30 
6. Milne (1949) 5 21 


As far as is known, the only errors in these tables are those for 
the Anderson and Houseman table listed by Sherman in Mathe- 
matical Tables amd Other Aids to Computation, 5, 81 (1951). 
Sherman also prepared I.B.M. punched cards for the table. 
A table of values f}; has been prepared by Guest (1952) for 
n6(1)104 and 7 to 5. The values in the range 6(1)75 are repro- 
duced in Table 7.10c. A table for the range 3(1)30 has been given 
by Birge (1947). 


7.6.8.2 Example 


In order to calculate the orthogonal moments the observations should 
be entered on a slip of paper in two columns, with observations correspond- 
ing to positive and negative values of e side by side. The spacing should be 
the same as in the Table of 7%(e) to facilitate multiplication of corresponding 
entries. The formation of sum and difference columns, as in Tables 7.6.2.1 
and 7.6.2.2, may be an advantage in preventing arithmetical mistakes. 
The orthogonal polynomial tables only list values Ti(e) for e positive. The 
even moments are obtained by multiplying the sum column by the values 
7(e), the odd moments by multiplying the difference column by T'j(e). 
The values Ti(e) are often omitted from the tables; they are simply 
the quantities 0, 1, 2, ... for n odd, and 1,3,5,... for n even. When the 
number of observations is large it is best to record the progressive total 
in the register of the calculating machine at a few points throughout the 
range, so that, if on checking the calculations a different value is obtained, 
the mistake can be readily located. 

Table 7.6.3 shows the calculation of the coefficients from the moments 
Aj. Values Sj, are given in the orthogonal polynomial tables. The power- 
series coefficients are calculated, using the values 8% from Table 7.10c, in 
the lower section of the scheme. 


If the fitted values are required only at the points of observation, it is 
not essential to calculate b,;. The fitted values may be calculated from 
the equation 
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(e) = is Tri(ei)， 


using the tables of orthogonal polynomial values。Thus 


“u, (—š) = aj — Taj — 154a; + 65844 = 9-4105. 


TABLE 7.6.3 


Fitting a third-degree curve using tables of orthogonal polynomials 


Sj,(= >T;°) and Bi; 
S62 Si, 79422 S;,1270152 S_ 139238112 


Bir 2 333 0.3r Bis —192-083r 
Boo 0.5 Bos — 160-125 
Xy? 54038 
Jat 1336 28789 
as 21-548387 Evè 25249 
4 — 20286 5181 
ai — 0-25542041 Ev? 20068 
A 72775 4168 
a; 0-057269239 Xw 15900 
4 — 1080557 8386 
ag — 0-007760497 Eo? 7514 
bss = B33 % — 0-00258683 
21 = Bis as + B11 41 + 0-979822 
bse = 22 d 0-0286346 


32 22 ご る 2 
bso = e d +a 1237815 


7.6.3.3 Calculation of fitted values for polynomials of different 
degrees. The tables of orthogonal polynomials are specially useful 
when it is desired to calculate the fitted values at the points of 
observation for two or more values of the degree p. This may 
happen when the polynomial is merely being used to smooth the 
observations and the degree p can be chosen to give the most 
suitable curve. The fitted values are calculated from the formula 


u(e;) = as a, Tile) +a Ty(e;) +... - 


Table 7.6.3.1 shows the calculations of the fitted values for the 
third- and fourth-degree polynomials in the example of Table 
7.6.2.1. The value aj is first calculated as in Table 7.6.3: 


4, —7599201 aM, 557 


a,  —0-00007332336 Xv? 6957. 
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TABLE 


F'itted values using 


40:7 — 03 21-5 一 9.2 —3-4 
+2-2 — 0:8 一 9.1 ー 3・3 
十 3.7 — 1-3 一 9.0 ー 3-2 
+ 5-1 — 1-8 — 8-8 — 3-0 
+ 6:5 — 2˙3 —8:6 一 2.7 
TUS — 2-8 一 8.3 ー 2-4 
十 9-0 —3-3 — 8-0 —2-0 
+ 10-1 — 3-8 ー 76 ー 1・5 
十 11・1 —4-3 ー 7˙1 ー 1・1 
+11-9 — 4'9 — 6:6 —0:5 
+ 12-7 — 5-4 — 6-0 0 
4-13-2 — 5-9 — 5-4 + 0-5 
+ 13-6 — 6-4 —4:7 +11 
+ 13-8 — 6-9 —4-0 +1-6 
+ 13-7 ー 7-4 —3-1 + 2-1 
+ 13-5 — 7-9 — 2-3 + 2-6 
+13-0 — 8-4 —1-4 + 3-0 
+12-2 一 8.9 — 0-4 T3:4 
+ 11・2 — 9-4 + 0-6 十 3・7 
+ 9・9 — 10-0 +17 +38 
T83 — 10-5 42-9 T 3-9 
+ 6-3 —11-0 +4-1 + 3:8 
+41 —11:5 +5:3 +3:5 
+1:5 — 12-0 + 6-6 3-0 
— 1-5 — 12-5 4- 8-0 + 2:3 
— 4:9 —13-0 T 9:4 T1:4 
— 8:6 — 13:5 + 10-9 -0-2 
ー 12・8 — 140 十 12・5 —1-2 
—17:4 — 14-6 T 14:1 — 3-0 
— 22-4 ー 15・1 十 15・7 ー 5-1 
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7.6.3.1 


orthogonal polynomials 


e negative 


e positive 


p=3 p=4 p = 3 p=4 


3 
な 
1 


UE 


Ust ua Us- Ug- 


12-7 9-3 11-9 8-5 —4-3 +45 
13-8 10-5 11-0 7*4 — 4˙5 + 0-3 
14-9 Ll 10-1 6-9 一 1.7 — 0-9 
16-0 13-0 9-4 6-4 —5:0 ー 1-4 
17:1 14-4 8-7 6-0 — 4-4 +4-0 
18-2 15-8 8-2 5-8 一 2.8 T2 
19-2 17-2 7:8. 5:8 一 了 2 + 3-2 
20-2 18-7 7-6 6:1 ー 15-7 十 3.9 
21:2 20-1 7:6 6:5 — 13:1 一 1.5 
21.9 21-4 7-9 7:4 . ー 2・4 
22-8 22-8 8-2 8-2 +6-2 — 6-2 
23:4 23-9 8-8 9-3 +13-1 — 8-3 
24-0 25-1 9-6 10-7 十 12.9 一 2.7 
24-4 26-0 10-6 12-2 4- 24-0 一 9.2 
24-7 26-8 12-1 14-2 + 47-2 — 8-2 
24-8 27-4 13-6 16-2 —54 +58 
24:7 277-1 15:5 18:5 一 8.7 T 17:5 
24-4 27-8 17:8 21-2 +16-2 + 8-8 
23-9 27-6 20-3 24-0 +74 —4-0 
23-1 26-9 23:3 27-1 — 11-9 — 6:1 
22-2 26-1 26-6 30-5 ー 11・1 ー 6-5 
20-9 24・7 30・3 34-1 一 6.7 — 6:1 
19-4 22-9 34-2 37-7 — 7-9 TUS 
17:6 20-6 38-6 41-6 — 10-6 T 10-4 
15:5 17.8 43-5 45-8 —11:8 11:2 
13-0 14-4 48-8 50-2 —10-4 T8 
10:3 10-5 54:5 54-7 — 10-5 — 6-7 
7T-2 6-0 60-8 59-6 — 3-0 —4:6 
3:6 0:6 67・6 64・6 + 0-4 + 8-4 
— 0:3 — 54 74:7 69-6 + 8-4 — 4-6 
4-5 2-2 82-5 74-8 +19-2 ー 7・8 
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Then columns of values a; 7;(e;) are formed by multiplying the 
values in the orthogonal polynomial table by a;. These may be 
checked by summing the column and comparing with the product 
of a; and the value X, 7'j(e;). This latter value may be obtained 


by summing the values 7(e。) in the table of polynomials. It will 
be observed that 


XTj(e)- O, j even; 
— 

P %2/4, n even, 
E Tile) = 
+ * (12 1)/8, modd, 


the + under the summation sign indicating that the sum is for 
the positive value of « for which the polynomial is tabulated. 

The rows are then summed to give the fitted values for e 
positive. The differences of the terms for even and odd values 
of j give the fitted values for e negative. The calculation of the 
fitted values is checked using the sums of the columns. 

As a final check, the residuals for the fourth-degree curve are 
formed. Since only one decimal has been retained, the rounding- 
off errors are rather large, and this accounts for the value --4-0 
for Xe,. The value obtained for Xv? is 6965-82, which compares 
well with the value 6957 obtained using the products a; -AI 


7.6.4 Other tables 

In special cases use may be found for certain other tables, of 
which those due to Kerawala and to Davis are the most important. 
Kerawala (1941) effectively combines the two equations 

a; = Ey, T(e)/|ZTT(e), 55, = EB; ax, 
into a single equation 
555 - Tes z(t) VilZ pj, (1) 

the quantities z,,(e;) being the smallest possible set of integers. 
Values of z,;(e;) and Z, are listed for polynomials of degrees up 
to the 5th and for % up to 30. This provides the most rapid 
method of fitting à polynomial if the degree is known, but the 
coefficients a; are not determined and hence the polynomials of 
different degrees cannot be obtained simply. 

Davis (1935) writes his equations in the form 


bpi Nix. Y My, (2) 


and tabulates the elements x; of the inverse matrix. The 
values are given to ten significant figures, but only for odd values 
of n. A similar table is given by Cox and Matuschak (1941) for 
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both odd and even values of ». Birge has suggested that there 
may be a considerable loss of accuracy due to the fact that the 
quantities xy; are non-terminating decimals, and it is certainly 
desirable to retain all ten significant figures in the individual 
terms of (2). Calculation of the polynomials of different degrees 
requires the recalculation of the sums (2) for each degree—strictly, 
only half the sums, as % = b,,, ; for p +j even. 


7.6.5 The fitted curve in terms of factorials 
The factorials are the quantities 
z = z(z—1)...(x—j-- 1) = z!/(z—j)!, (la) 


and the reduced factorials are the binomial coefficients 
$T RE ME 
j zz»! zascxl(z-—3j)!j!. (15) 


The fitted curve may be expanded in terms of the factorials 
instead of the powers, in the form 


2 : 2 の 
ule) Eb n = Sb . (2) 


The orthogonal polynomials 7Z;(z) can also be expanded in terms 
of factorials, 


' = T) 
Zr) = Z2Bu 20? = Sten) (3) 


Then the orthogonal coefficients a, are given by 

a; = M ilS = Ey; Tilt) Si, 
or a; = TB 45) S, = EBug Mil =, (4a) 
where My) and M, are the factorial moments, 


Moy = Dyer", My = sw = MTK. (45) 


Also the fitted curve is 
Ta, Tr) = La; ZBu5 2? = La; 2%) 
and on comparing this with (2), 
55% = TB. by = UB jx 4r (5) 
Thus if the factorial moments are evaluated, the fitted curve 
can be found by means of (4a) and (5), provided the coefficients 


are known. Table 7.10 gives the values of B. for n 2(1)75 and 
for polynomials up to the fifth degree. The explicit formulae for 
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Bri; are given in Table 7.10e, and the proofs are given in $ 7.7. 
The quantities S;, = Yet) are given in Table 7.105. 

When factorial moments are employed the range of the inde- 
pendent variable z will be taken to be from 0 to n—1. Factorial 
methods are only of use when the observations are equally-spaced. 

7.6.5.1 Calculation of factorial moments. The factorial moments 
can be obtained by repeated summation, without multiplication. 
The values y; are entered in a column in decreasing order of z, 
the progressive sums being recorded in an adjoining column. 
If an adding machine is being used, the progressive sums are 
obtained by printing the sub-totals after each addition. These 
progressive sums are then treated in the same way, as illustrated 
in Table 7.6.5. 


TABLE 7.6.5 


Calculation of factorial moments 


Column 0 1 2 
Row 
n=l Va-1i ヴァー ュ Yn-1 
»—2 Yn-2t+Yn-1 ダ ョ ーs + 2Yn-1 ダーs + 9Un-1 
% 一 3 V- T- T- ダーs + 2/2 十 89。ー ュ ダーs 3/2 + 5-1 
2 YotYst---+Yn-1 ½½ 2/8 *yac- ya +... 1 $(n — 1) (n — 2) 1 
1 Vict Vade. Wa- 2/1 + 2/2 .. . 4 (1 — 1) 7。ー ュ omitted 
0 ⁹%⁰ fr t Ya omitted omitted 


The entry in row k, column k, will be proved to be Mx- 
More generally, the entry in row j, column k is 


b 
Yik 一 = ( k ? Ys- (1) 


S 一 了 
For the entry y;, is 


Vjk = Vj, ky t VL. ke 
and if (1) holds for the earlier entries y; , , and ½ 1. x, 


キル 一 エータ nA (s+k—j—1 
Vix = ( bh ) yo > ( = )v. 


S 一 了 s=j+1 


lI 


II 


a-1 (/s--k—j—1V | [s -k—j—1 
y; = {( 3 ** p )]». 


s=j+1 
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and so n3 (s+k—j 
ur = ( k ; Ys 
s=j 
and (1) follows by induction. Hence 
n-1/ gç 
Vu 之 (;) Ys = My = M/F, (2) 
s=k\ 


7 
since (;) vanishes for values of s from 0 to * -I. 


7.6.5.2 Calculation of fitted values from the differences of zero. 


k 
AC) - ("x )-G) 
TS E 7) 


and so SH = [e al (1) 


Hence the finite differences of the fitted polynomial are 


The finite differences of 0 are 


alu, n $ bps Gf). 


and at z = O, 


A«u,(0)) = Sb vel " 


J) = bota i gl bn iq) (2) 


as 0 is zero except for r = 0. 


The fitted values for integral values of z can be built up from 
the differences at x = 0 by summation. This is illustrated in 
Table 7.6.5.2. 


7.6.5.3 Example 


Table 7.6.5a shows (in condensed form) the method of calculating the 
moments M; for the example of § 7.6.2.1. It is not really necessary to 
record the progressive sums in the last column unless there is & possibility 
that & polynomial of higher degree may be required. 

Table 7.6.5.1 gives the calculation of the orthogonal coefficients a, and 
the reduced factorial coefficients b, . 

The building up of the fitted values by repeated summation is shown in 
Table 7.6.5.2. The differences of zero A/[u(0)] are simply the coefficients 
b, obtained in Table 7.6.5.1. The values A/[u(r)] are obtained in turn 
as A?[u(x — 1)] + A^*1[u(x — 1)], commencing with high values of j and finally 
finishing with the fitted values corresponding to j = 0. 


15 
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TABLE 7.6.5a 


Calculation of factorial moments (Example 7.6.5.3) 


y 0 1 2 3 
7 7 7 7 7 
3 10 17 24 81 
1 11 28 52 83 
56 1028 25925 498976 7161225 
48 1076 27001 525977 7687202 
55 1131 28132 554109 8241311 
73 1204 29336 583445 
65 1269 30605 
67 1336 
TABLE 7.6.5.1 
Fitted curve in terms of factorials 
n 62 
(a) Br; (from Table 7.104) 
Bio»; 1 
Brox 一 30.5 Ban 1 
Bton 610 Bun — 60 に た で の 2 
Bus — 10797 — Bus 2124 fu —177 Bs 6 
(b) S (from Table 7.10b) 
Soo 62 Sy, 19855-5 S, 5,083008 Ss 1253,143008 
(e) Men (from Table 7.6.5a) 
Mio; 1336 My; 30605 Mi, 583445 Mig 8,241311 
2 
Ga = MS; = 2 Pun M 33/8553 Xv? = Xy? — Ta, M; 
Zy? 54038 
a = 1336/62 = 21-548387 Ev? 25249 
a, = —10143/19855:5 = —0-5108408 Xvi 20068 
a, = + 145550/5,083008 = + 0-02863462 Zw? 15900 


as = —3241671/1253,143008 = —0-002586832 Xv? 7514 


3 
bis = > Bund 
k=uj 


Drsol 82.526175 bisu ー 7.723349 51321 十 0.5151385 51331 — 001552099 
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TABLE 7.6.5.2 
Fitted values obtained from the differences of zero 


x u Au A A 
0 82-5 

一 7.723 
1 74-8 +0-51514 

— 7-208 — 0-0155210 
2 67-6 +0-49962 

— 6-708 — 0-0155210 
3 60-9 4- 0-48410 

— 6-224 — 0-0155210 
4 54-6 + 0・3685S 

— 5-756 — 00155210 
5 48-9 7-045306 

— 5:302 — 0-0155210 
6 43-6 + 0-43754 

— 4:865 — 0-0155210 
7 38-7 + 0-42201 

— 4:443 — 0-0155210 
8 34.3 + 0-40649 


— 4:036 — 0-0155210 


77 PROPERTIES OF THE ORTHOGONAL 
POLYNOMIALS FOR THE EQUALLY-SPACED CASE 


The orthogonal polynomials are, in terms of the variable e, 
j 
Tje) = X Base (1) 


while in terms of the variable x which takes the value 0 to n—1 
at the points of observation 


Ty(x) = bo gn, (2) 


It was shown in § 7.2.1 that the values of the orthogonal poly- 
nomials are independent of the origin, so that T;(x) and Tj(e) are 
identical. It is convenient to introduce another orthogonal poly- 
nomial P;(x) for which the constant term is unity, 


Pj(z) = Tj(x)/Biyy = Erge. (3a) 
Then 74; = Pinn Bon oj = 1, Bap = Tyj[73- (35) 
7.7.1 The factorial coefficients Biz; 


A general formula for 8% will now be developed. The two 
formulae 


(a+q)@ の (を ) 一 (z +q) t (1a) 
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n=1 


and L (xg)? = (n-- g)*?J(r-F 1) - g'*?J(r + 1) (16) 
z=0 


will be needed in the discussion. The formula (la) is obvious 
when both sides are written out as products of factors (xj). 
The second formula can be derived from the easily verified 
relation Eq) L 9% = (q 1) %. 

On replacing k by ++ 1 and q by % 十 9 一 1, 

(n+ g)*9J(r - 1) = (n—1+q)P) - 174)% % r + 1). 
Continued expansion of the last term in this equation leads to 
(1b). g@+)/(r+1) vanishes when r > g. 

From the orthogonal property, 


n—1 
> (x-9)9 P(x) 20, q <j, (2a) 


2-0 


&nd so, using (1a) and (15), 
j 
DI g)e***n[(g--k--1) 2 0, g<j. (25) 
k=0 
Division by the common factor (n+ g)«*?) gives 
j 
3 yj(n— 1) /(g--b--1) 2 0, q«j. (2c) 
k=0 
The solutions 7,; of these j — 1 equations can be found in the 
following way. (2c) is written 
j j 
X u(n-1)9/(g--k--1) = Xz(q- k4-1) 
k=0 k=0 
= é(q)/(q +j  1)9*9, (3) 
where ZU = m, (m — 1)*) 
and ó(g) is a polynomial of degree j which is to be determined. 
Now, from (2c), ) vanishes at g == 0, 1, , - 1, and so is of the 


form Cd. To determine the constant C, (3) is multiplied by 
q+ 1, giving 


j 
Zot Z s (q+ / (gc ke 1) = $(9)/(a +j + 1). 
When 4 is set equal to — 1, 
$(71) = 0(— 1) = jàz, = j, 
since zç is unity. So C = (一 7 


and Sallg+k+d = (CY tig Dots. (4a) 
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The value z, is found by multiplying (4a) by (g--k--1), and 
setting g = —(k+1). Thus 
zy = (- Y (- k- D E) (= Y! 
-(—)yFK(jr-kM(j—-k)Mklk!, ^- (45) 


and Try = (— )# T ? (|/e- 1)*), (ac) 


On dividing this by 7;;, the formula 


に H ) 0 ; 

ux E k] (n — 1) 

Bu 一 (一 ) 一 (2) Ë (n— ] 
2 

is obtained for the coefficient Bizz) 


7.7.2 The sum of the squares of the orthogonal polynomial values 
An expression for Z:P2(z;) will first be derived. Since 
(& 4-j)9 = x + factorials of lower degree, 
> Pilz) = v, D zÉ) Ple) = my > (z, +j)” P), 
1 t 


i 


j 
or ZP?(z)- „ D mig a (. Tj)? 
T i 


j ; š 
ーッ È mun Ca Uh. 
Using (7.7.1,3), 
j 
LPj(æ.) = myn +j)I Y z,/(j-- k 1), 
k=0 
and, substituting for the sum from (7.7.1,4a), 
EPj() = yla +j) (— y j1Qj + HD. (1) 
The sum of the squares for the polynomial T,(x) will be given by 
ZT$(z,)- XPF(x;,)/73,, 
and so, from (7.7.1,4c) and (1), 
9 Y 
ZT3(x,) = (n 4- j)9*V (n — 1) 5 1/(2; + ern). 


This is equivalent to the forms 


E 多 十 了 2) * 
ZET3(z,) -in( MG) (2a) 
1714 
and ET?}(z;) = CEES n(n?—1)... (n?—J?). (2b) 
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Since the orthogonal polynomials are independent of the choice 

of origin, these equations also give the sums £75(e;). The values 
R; = (23)! (27-1) !j* (2c) 

of the inverse of the numerical coefficient are given in Table 7.10g 

for the first ten polynomials. 


7.7.3 Recurrence relations 
For the equally-spaced case the quantity m; in (7.2.6,2a) 
vanishes and 


ele) = Tyre) + pj T). (9), (1a) 

or T, (e) = €T;(e) — p; T-x(€), (15) 

with p; = ET$(e)/Z3 4(e;). (2) 
On substituting for 3/7?(e;) from (7. 7. 2, 25), 

p; = j° (n? — j?)/4(4 1). (3) 


The expressions p; are listed in Table 7.10g for polynomials up to 
the ninth degree. 
The recurrence relation for the coefficients B; is 


Bei 741 = Bx; — p; Bus, 11 (4) 


The values B,; can then be built up in turn. The expressions for 
polynomials up to the ninth degree are given in Table 7.10a. 


7.8 EQUALLY-SPACED OBSERVATIONS 
WITH DIFFERENT WEIGHTS 


The usual method of procedure here is to calculate the sums 
Ew, y, and Zw, sitk, and to solve the resulting normal equations 
by the Doolittle method. The scale and origin of the inde- 
pendent variable may be altered so that the values z; are succes- 
sive integers and the origin is near the centre of the range. Since 
the quantities 57 and Si will depend on the weights, they cannot 
be tabulated but have to be obtained from the Doolittle scheme. 
The procedure is identical with that given in earlier sections, and 
need not be discussed further. 

The method of curve fitting using factorials can also be modi- 
fied for use in the present case. This modification will now be 
considered. 


7.8.1 Factorial form of solution 
If the fitted curve is required in the factorial form 


ula) = Et (5. (1) 


J 
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the least-squares condition for the coefficients br leads to the 
normal equations 


Eb, ze n = Xw; (i) ’ (2a) 


or Ib piy Pure = Mizi (2b) 


The moments M}; can be calculated by repeated summation of 
the values w,y;, as in $ 7.6.5.1, but the quantities ¢,;,; cannot be 
directly caleulated in this way. However, it will be shown in 
$ 7.8.1.2 below that 


O0 = 24901 6. ca 


and so it follows that the quantities Z, can be expressed as 
linear sums of the values 


7 x; 
Win = Ew 2) 


These latter values can be obtained by repeated summation of 
the quantities w;. The linear sums are 


m 
dum = > ( ) W L ? Wia- (35) 


g N 


These formulae are written out in detail in Table 7.10f for poly- 
nomials up to the fifth degree. 

Once the Sr have been calculated, the equations (2a, O) are 
solved by the standard Doolittle method. 


7.8.1.1 Example 

Table 7.8.1 shows a series of observations y which are spaced at equal 
intervals of the variable >. Observations at some of the values of z are 
missing. This example can be treated by the method of $ 7.8.1 by setting 
w; equal to 1 for the observations which are present and equal to 0 for 
the observations which are missing. Table 7.8.1.1 shows a, portion of the 
scheme for the calculation of M,;; and Wix by repeated summation. 

The values Gti are then evaluated in Table 7.8.1.2, using the formulae 
of Table 7.10f. Finally the normal equations are solved by the Doolittle 
technique. The fitted curve is obtained by multiplying the coefficients in 
the Doolittle scheme by the factors 10" 10-9 = 10 x 10-7. The curve is 


u(x) = 0-4875 + 0-4253x — 0-02950(F) + 0-003516($2). 


It will be observed that the number of significant figures is rather small, 
because of the small value of S。。. 
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TABLE 7.8.1 


Equally-spaced observations with some of the set missing 


z y a y a y 
0 0-4 
1 0-9 11 ーー 21 7-7 
9 1:4 12 4-1 22 8-3 
3 -一 13 4-6 23 — 
4 1-9 14 — 24 9-6 
5 2-5 15 5:2 25 10:6 
6 一 - 16 ーー 26 11:3 
7 2-9 17 5.9 2" — 
8 3-4 18 6-6 28 12-5 
9 — 19 7:0 29 13-7 

10 4-2 20 7-8 30 14-7 

TABLE 7.8.1.1 
Calculation of factorials (Example 7.8.1.1) 
* wy 0 1 2 3 


7 2:9 140.1 2265-8 22299-3 162700-1 
6 — 1401 24059 247052 187405-3 
5 25 142-6 2548-5 27253.7  214659-0 
4 L9 1445 2693-0 29946-7 244605-7 
3 — 1445 2837-5 327842 277389-9 
2 14 145.9 2983-4 35767-6 

1 

0 


0-4 147-2 
x の 0 1 2 3 4 5 6 
T X 18 236 2104 14425 81679 398600 1723998 
6 0 18 254 2358 16783 98462 497062 2221060 
5. d 19 273 2631 19414 117876 614938 
4 1 20 293 2924 22338 140214 
3 0 20 313 3237 25575 
2 3 21 334 3571 
R 22 356 
0 1 23 
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TABLE 7.8.1.2 


Calculation of fitted curve in terms of factorials 


(a) Quantities W;;; (Table 7.8.1.1) 
Wa 23 Win 356 Wio 3571 
Wis 140214 Ws; 614938 
(b) Quantities Mp (Table 7.8.1.1) 
Mio 147-2 Mm 3130.2 Mt 35767-6 


(c) Elements of matrix (Table 7.10f) 


doa 23 Pion 356 Qon 3571 
dan 7498 Frier 83867 
dis 998305 


(d) Abbreviated Doolittle scheme 


Ms) 
We) 


Mis) 


tos: 
$us; 
$us 


25575 
2221060 


277389-9 


25575 
637581 
7908673 


$i; 64577483 


Factors removed: $;,, 10* 1084+"); M., 108107 10%; g = 1, r= 1,8 = 1 


2-300000 3-560000 3-571000 2-557500 
7-498000 8-386700 6-375810 


9-983050 1-908673 

6-457748 

2-300000 3-560000 3-571000 2-557500 
1 1:547826 1-552609 1-111957 
1-987739 2-859412 2-417243 

1 1-438525 1-216077 

0-325348 0-460609 

1 1-415744 

0-022260 


1 


0-048752 0.425302 — 0-295026 0-351645 
1:048716 1:425440 0-704747 1-351802 


1-472000 
3-130200 
3:576760 
2-773899 


1-472000 
0-640000 


0-851800 
0-428527 


0-065985 
0-202813 


0-007828 
0-351645 


13-460500 
28-950710 
33-426183 
26-073630 


13-460500 
5-852391 
392 
8-116198 
4-083131 
129 
0-851941 
2-618553 
557 
0-030091 
1-351802 
645 


7.8.1.2 Calculation of factorial products by summation. In this 
section the relation (7.8.1,3a) will be established. It will first be 


shown that 


5 
gard 一 E () jeo ud (z—r)*-n. 


q=0 


q 


(1) 
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If (1) is true for à particular value of r, then 


o * 
z0) gU) = p> 0 jem a G4) ( — r) (r—r— ])&-7-0 
a=0 Md. 


li 


| 21 (^) jezo (x UD +(j+q-r) eo] | 
q=0 


x (r—r-—1)*-r-n 

— | Y (eue qe 4 ( " )) 十 2GHrHD 4 je) d 
q=1 Ng) 一 也 | l 

x (= Y-) b. 


Since — — I ) = yy! 
G q—1 q 
it follows that 
TEl/y--.]Y. š 
zÜ) yU) 一 | > ( i ro (x—r w 1) 9, 
q=0 q 


and so (1) follows by induction. 
For the value + = k, (1) takes the form 


r E (Kk. 
の ⑦) ah) = x( Mg. (2) 
4 =. 


(i) (i) - 2) e- zm GM 


and the terms on the right can be regrouped to give 


(9 - BO) (Pe) (550) 


which is (7.8.1,3a). 

7.8.1.3 Factorial sums with the origin near the centre of the 
range. If the number of observations is large, the sums may be 
reduced in magnitude by choosing the origin of z near the centre 
of the range of x. The observations are divided into two groups, 
each group being summed from the extreme values of z towards 
the origin, as illustrated in Table 7.8.1.3. It may be shown that 


Then 


8—1 '4 
Ma = > 1400 = xk (I, K- (1a) 
12 rr 


where y;, is the element in row j and column k. The sums in the 
two halves are added for even values of k and subtracted for 


odd values. 
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The proof of (1a) follows on the same lines as that in $ 7.6.5.1. 
It was shown there that 


s—1 (i 
22 (i) = Vii (15) 
0 / 


When q is replaced by —7, 


(+7?) = er ne -e -N. 


and so #-i x2 (— " x (;) Yi- (1c) 


4=—1 


On combining (15) and (1c), (1a) is established, 
The choice of origin near the centre of the range is only worth- 


while when the observations are weighted and the sums ze 


have to be caleulated. If the observations are all of equal weight, 
the method of $ 7.6.5.1 should be used. 


TABLE 7.8.1.3 


Factorial sums with the origin near the centre of the range 


(0) (1) (2) 


Y-r Y-r 7 — ダー 
ダー キュ  V-eacy- y-r + 2y-. ダーr ュ + 3y-, 


+ 9A *Y-1 +Y-2 +- +Y-r *y-i + Y-a 十 … Ty- *y-it 3Y-2 +... 


Yo *yoctWyict -+Y omitted omitted 
Yı 2 十 ga 十 . i “Yrtyz+ ... omitted 
Va ga 十 gs 十 % - 1 VactDPyacto o. *Ya + 3ys + 
yi PST Ys~1 Vi 


7.8.2 Observations of equal weighi, but some of the series missing 

It often happens that, although the interval between successive 
observations is constant and they are of equal weight, several of 
the series have not been recorded. For example, the observations 
may have been made at equal intervals of time, but poor condi- 
tions may have prevented the taking of some of the set. 
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Equally-spaced case, observations missing: range of x, —r' to +r 


M, M, 
Ea? (L — R) Xx(L-—R) 
138217-2 922-2 
Exs xx Ix 
$ r+1 
0 
3 
-> TT 
^ + terms marked — no. 
missing 
35081 197 11 
L 
v+ 
missing 
terms 
marked 
Sa — | 
+ 
05 * * 
0 5: 
+1 +1 41 ーー 
32 8 2 5-9 
243 27 3 6-6 
+ 1024 +64 +4 7-0 
3125 125 5 7-8 
+7776 +216 +6 7-7 
16807 343 T 8-3 
一 32768 一 512 一 8 ーー 
459049 +729 +9 9-6 
100000 1000 10 10-6 
161051 1331 11 11-3 
+ 248832 4 1728 +12 ーー 
371293 2197 13 12-5 
537824 2744 l4 13-7 
759375 3375 15 14-7 
1,048576 4096 16 
1,419857 4913 17 
1,889568 5832 18 
2,476099 6859 19 
3,200000 8000 20 
4,084101 9261 21 
5,153632 10648 22 
6,436343 12167 23 
7,962624 13824 24 
9,765625 15625 25 
11.881376 17576 26 
14.348907 19683 27 
17.210368 21952 28 
20,511149 24389 29 
24, 300000 27000 30 


to 


M, 


(LTH) +y(0) 
147-2 


R 

= ーー 
missing 
terms 
marked 


a | * | 
1 — 8 


else 
や or, 


ppt 
A OA 


1240 


1240 


M, 
Ez*(L--R) 
13879-4 
Zrt Exs 
178312 30,482920 
178312 30,482920 


+ terms marked 


1993 302941 54,149533 


„ Ú mae 


10000 


14641 
= 20736 
28561 
38416 
50625 


65536 
83521 
104976 
130321 
160000 


194481 
234256 
279841 
331776 
390625 


456976 
531441 
614656 
707281 
810000 


の 9 


=F 

64 

729 

— 4096 
15625 


— 46656 
117649 
— 262144 
— 531441 
1,000000 


1,771561 
= 2,985984 
4,826809 
7,529536 
11,390625 


16,777216 
24,137569 
34,012224 
47,045881 
64,000000 


85,766121 
113,379904 
148,035889 
191,102976 
244,140625 


308,915776 
387,420489 
481,890304 
594,823321 
729,000000 
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If more than a third of the observations are missing, then no 
special technique can produce any great saving in time. But if 
less than a third of the observations are missing, the scheme of 
Table 7.8.2 is worth using. Here the elements % = Xa2/+* are 
calculated by subtracting the contributions of the missing ele- 


» 
ments from a tabulated value Y; z/**. The procedure is illustrated 
0 


in Example 7.8.2.1. 
The method of repeated summation (§ 7.8.1) can also be used, 
with the weights of the missing observations being taken as zero, 


as in Example 7.8.1.1. 


7.8.2.1 Example 

Table 7.8.2 shows the calculation of , and M, for the observations 
listed in Table 7.8.1. The origin is chosen near the centre of the range, so 
that the range of x is from —7' to +r. Here r and r’ are both 15. The 
moments are calculated in the usual way. The quantities Xx? are calculated 


T T 
by subtracting from Ca (-) > x’ the contributions due to the missing 
0 0 


terms. These missing terms are obtained by marking the values of zf in 
the calculating scheme, the sums Ex’ from Table 7.10g. 

The solution of the normal equations is then carried out by the standard 
Doolittle procedure in Table 7.8.2.1. 


TABLE 7.8.2.1 


Solution of normal equations (Example 7.8.2.1) 


Factors removed: x, 10%,¢g = 1; y, 107,7 = 1; elements divided by 10*, s = 1 


2-300000 0-110000 1:993000 0-049700 1-472000 5-924700 
1-993000 0-049700 3-029410 0-922200 6-104310 

3-029410 0-035081 1:387940 6-495131 

5-414953 1:382172 9-911316 


2-300000 0-110000 1-993000 0-049700 1:472000 5-924700 
1 0-047826 0-866522 0-021609 0-640000 2-575956 
957 
1-987739 — 0-045617 3-027033 0-851800 5-820955 
1 — 0-022949 1:522852 0-428527 2-028430 
430 
1-301385 0-061482 0-131968 1-494837 
1 0:047244 0:101406 1-148651 
650 
0-801251 0-046964 0-848215 
1 0-058613 1:058614 
613 
0-536928 0-341532 0-098637 0-058613 


1-536926 1-341530 1-098638 1-058614 
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7.8.2.2 Hartley's meihod. The subscript i will be used to denote 
one of the set of n possible points of observation. Points for 
which an observation was obtained will be denoted by the sub- 
script o, and points for which an observation was missed by the 
subscript m. The fitted curve will be written in the form 


we) x Ja, Le), 
where the polynomials ye) are orthogonal over the n points e;. 


The least-squares principle states that the coefficients wj are to 


be chosen so that 
2 


三 lo- 了 Ge 
0 j 
is minimized, and so the normal equations are 
-N. T ve) = 0. (1a) 
9 
If these equations were solved for the a;, and the fitted values 
Ym = (6%) = xa; Tilen) (1b) 


at the missing points calculated, then the normal equations 
(la) can be written as 


5 Z Ne, の (<) Tyle) = 0. (1e) 


The value y; is the observed value y, or, if the particular observa- 
tion is missing, the fitted value y,. Since the polynomials are 
orthogonal over the e;, 


a; = Du T(e) 2 Ty) = P Yo Tle) + Ey, Ten) / ZTA«). (2) 


The value =7'?(e;) can be obtained from the tables. 
In practice, the polynomials Ti(e) introduced in $ 7.6.3 are used, 
and 


a = [Zi Tj) E Yn Te) /I, (3a) 
with Ym = Zaj Tilem). (3b) 
Equations (3a) and (3b) are solved by an iterative process. 


Reasonable values y{ are first assumed, and the values aj calcu- 
lated from (3a): 


aj = (Zy, Tie.) + Ey T4(e,))/ ET). 
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Second approximations % are obtained by substituting a in 
(3b). These are substituted back in the second term of (3a) to 
give a second approximation aj. The iterative process can be 
continued, better and better approximations to the values a; and 
y,, being obtained. 

If only the fitted curve and not the standard deviations are 
required, it will usually be satisfactory to stop at the second 
approximation ag. If the sum of the squares of the residuals is 
to be calculated by the formulae of $ 7.2.5, it is necessary to 
proceed at least to the third approximation. The approximations 
approach a; from one side only, and it is often possible to get a 
better approximation by extrapolating the trend of the values 
aj, aif}, aj), | 

It is possible to work with the corrections Aa; and Ay,, rather 
than with the full values a; and Ym- This is the procedure sug- 
gested by Hartley. However, if only the corrections are used, a 
mistake in one of the earlier approximations may be undetected, 
while if the full values are used all earlier mistakes are auto- 
matically corrected by the iterative process. 


7.8.2.3 Example 

Table 7.8.2.2 shows the application of the Hartley method to the 
observations of Table 7.8.1. There are 23 observations, and 8 of the set are 
missing. The moments Xo Tj; for the observations actually made are 
calculated, using the tabulated orthogonal polynomials for n = 31. The 
values T; for the missing observations are entered in the scheme, and 
values %%“ are assumed. The products % T} are added to Xy, 77, and 
the sum is divided by ET? to give the first approximations aj{}. The 
second approximations yí? are then calculated from these values ojU, 
and the second approximations aj? from the values /. 

When the third approximations have been calculated, new values az) 
are assumed from the trend of the previous values. For example, 


agi? aj) = 0-0082, age ag = 0-0015, 


and so the next correction might be of the order of $$ x 0-0015 or 0-0003, 
the following correction $2 x 0-0003 or 0-0001. Thus a reasonable value for 
ag (9 is 6-1580+ 0-0003 + 0-0001, or 6-1584. The values ag may then be 
used to give the next two approximations. The process is continued until 
the required number of significant figures has been obtained. 

It will be noted that the coefficients a; are for the polynomials with 
n = 31. If the curve is required in power-series form, the values Bj; for 
n = 31 must be used. 


7.8.2.4 Direct calculation of values at missed points. If the 
missing values are ignored in (7.8.2.2,3a), the coefficients 


Qj, = 2o 100) / Ter) = Eyo T;(eo)/S;; 
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TABLE 7.8.2.2 


Hartley's iterative method 


T? ™ 2 ン T. 
ET? 31 2480 158224 6724520 
Eyo T; 147-2 922-2 2103-4 4670-7 
Missing values 
yp sy ye y yt T; T; T; 
11-9 11-8880 11-8968 11-9015 11.90096 | +12 +64 +2 
8-9 8-9975 9-0262 9-0332 9-03301 +8 一 16 一 532 
5-5 5-6987 5-7173 5-7213 5-72127 | +1 —79 一 119 
4-9 5-0238 5・0347 5-0370 5-03700 —1 一 79 十 119 
4-1 4:1242 4:1236 4-1234 412339 | —4 —64 +426 
3-8 3-5566 3-5501 3-5484 3.54848 | —6  —44 +539 
2-7 2-6798 2-6699 2-6668 2-66705 | —9 +1 +471 
1-6 1-6841 1-6809 1-6778 1:67833 | — 12 +64 —2 
aj} (from y) 6-148387 0.425040 0.00996372  0-00073635 
aji} (from yf?) 6-156539 0-425543 0.00987977 0:00070789 
aße] (from /) 6-158048 0425750 000986640 000070424 
aj(9 (from trend) 6.1584 0-42587 0-009864 0-0007036 
ats) (from /) 6.158368 0-425826 0-0098637 0-00070329 
aj(9) (from /) 6-158371 0-425819 0-00986374 0-00070333 
Power-series coefficients 
Bi 1 Bss 0-83r Pis — 119-83r Boo 1 Bo» — 80 
bas 0-00058611 532 0-00986374 
b,, 0-341537 bzo 5-369272 
and the fitted values 
2o(e。) Tao byt 
are obtained. Then (7.8.2.2,35) becomes 
y, = (e) + LLY, Ties) Tile) / Si 
and so 
= (Srm E > T;(e,,) 25 S, Yn = ugler), (1) 
m 
8,, being the Kronecker delta. To solve these equations for Ym 


it is necessary to invert the matrix whose elements are the 
quantities in brackets on the left-hand side. Thus a direct calcula- 
tion of y,, is really only practicable when one or two observations 
are missing. If one observation is missing, 


Ym = tolen) f1 be Vs (2) 


78 EQUALLY-SPACED OBSERVATIONS 225 


If two observations are missing, 


Yma = C3 Uo(Emr) + G12 uo), Ymo = Cor ut + Gee %), 


(3) 

where 
Gy = 0 m T2) / 87 / D, 622 — ü ST: 52) / 85 / D. (4a) 
612 = {ZT lem) 75052) / 8% / D, (45) 


and D = (1—ET7*(e)/85 {1 — CTI /S 


— {27} (Emi) Ti (en) Se. (ac) 
When the % have been calculated, the coefficients a; are given 


b ‘= の u 
y a; = Qjo T KS Ym T's (€m)/S};- (5) 


As a check on the calculations, the values Xa;T;(e,) may be 
calculated. These values should equal ym. 


7.8.2.5 Example 
In Table 7.8.2.5 a cubic curve is fitted to the 23 observations obtained 


by omitting the values at e = +7 and e — —3 from the set listed in 
Table 7.6.2.2. The moments 4% are calculated using a table of orthogonal 
polynomials, omitting the contributions at e — --7 and e — —3. 


TABLE 7.8.2.5 
Direct calculation of values at missed points 


€mit 7, em2 一 3 


Mio 13566-11 47901-85 — 25324-19 112697-80 


e£ 25 1300 53820 1,480050 

4% 542-6444 36-847577 — 0-4705349 十 0.07614459 
Tilem) 1 十 7 ー3 — 259 
T^ (ens) 1 «S —43 十 211 
1—-37/2(,,)/S5; 0-88864092 

1— X7T72(e,.1)/87, 0-87681700 


TIE) Tyte SY, | —0-01068072 
(7.8.2.4,4a-c) D 0-77906139 
G 114065583 
612 一 0.01370973 
G,| 1.12547870 


uten) | 782-26759 468.40118 
(7.8.2.4,3) Ymi 885-87643 516-45087 


Ey mi T lemi)! S/, 56-09309 3-578294 — 0-4620033 — 0-08139648 
aj 598-73749 40-425871 — 0-9325382 — 0-00525189 


Check  Za;TT;(e,,) | 885:87644 516-45087 


16 
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79 NOTES AND REFERENCES 

(7.1) The Gauss-Doolittle method and its variants have been rediscovered 
many times. An account of the various forms of solution of linear equations 
is given by Dwyer (1951). 

(7.2) The relations between the orthogonal polynomials and the quantities 
occurring in the Doolittle scheme were diseussed by Guest (1950a). A 
calculating scheme similar to Table 7.2.3 is given by Wishart and Metakides 
(1953). 

(7.3) The use of matrix theory in the discussion of least-squares fitting is 
well presented by Hayes and Vickers (1951). 

(7.4) The discussion of changes of origin is based on that of Birge (1947). 

(7.5) À very large number of papers on the solution of linear equations 
have appeared in recent years. Full bibliographies are given by Bodewig 
(1947), Paige and Taussky (1953), and Taussky (1954); see also Forsythe 
(1953a). A general bibliography of papers on numerical analysis has been 
prepared by Householder (1953, 1956). 

The normal equations are often ill-conditioned (Booth, 1955; Riley, 
1955). A simple account of the troubles encountered with ill-conditioned 
equations is given by Deming (1937). 

(7.6) A useful treatment of the fitting of polynomials to equally-spaced ob- 
servations, with a historical account of earlier work, is given by Birge (1947). 

The advantage of fitting by power moments rather than by orthogonal 
moments is that less quantities require tabulation. It is convenient to 
prepare mimeographed sheets of the powers e/ in Tables 7.6.2.1 and 7.6.2.2, 
so that the observations can be entered directly beside the powers. The 
difference in the times required for the two methods is so slight that the 
choice of method is largely à matter of personal preference. 

(7.7) The treatment of the properties of the orthogonal polynomials for the 
equally-spaced case is based on Milne (1949), Birge (1947), and Allan (1930). 

(7.8) The factorial method is discussed by Fisher (1948), Aitken (19336), 
and Guest (19535). The ‘missing plot’ method of § 7.8.2.2 is due to Hartley 
(1951), and is the quickest method if only a small number of observations 
are missing. It should also be very suitable for use with high-speed 
automatic computers. However, the usual formulae given in Chapter 8 
for the standard deviations of the coefficients and fitted values are not 
valid when this method is used. 

7.10 TABLES 


TABLE 7.10g 
Orthogonal polynomials for equally-spaced observations 
(a) Sj, = XZ T3(e) = n(n* — 1) m° — 4) .. (n* —j°)/R, 
t 
Values of R, = (24)! (2j+ )1/ W 
R, Factors j R; Factors 


1 11,099088 2432 72 11213 
12 2² 3 176,679360 26385 112132 
180 22 32 5 2815,827300 223452 112 132 17 
2800 2452 7 44914183600 2552 112 132 172 19 
44100 2? 3? 52 72 


698544 2¢ 347711 
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TABLE 7.10a (cont.) 
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(b) p, = S,4/8S;, ,-1 = j*(n* —j?)/4(4 j? — 1) 


Ss, 


2 j Pi 
1 (n3 — 1)/12 6 9(n? — 36)/143 
2 (n? — 4)/15 7 49(n? — 49)/780 
3 9(n? — 9)/140 8 16(n? — 64)/255 
4 4(n? — 16)/63 9 81(n? — 81)/1292 
5 25(n? — 25)/396 
(c) Values By, [Ti (e) = Xj, e*] 
(i) Bo = — (n* —1)12 
(ii) Bas = —(3n3— 7)/20 
(iii) Bag = — (3n2—13)/14 Bog = -4-3(n? — 1) (n? — 9)/560 
(iv) Bas = —5(n*— 7)/18 Bis = + (18n* — 230n? + 407)/1008 
(v) Ba, = —5(3n?— 31)/44 Bas = + (5n*— 110n? + 329)/176 
Boe = —5(n*?— 1) (n? — 9) (n? — 25)/14784 
(vi) 。。 = —7(3n2—43)/59 — B,, = -- 7(15n* — 450n? + 2051)/2288 
Bi, = — (35n* — 1645n* + 17297n? — 27207)/27456 
(vii) Bss = —7(n*— 19)/15 Bag = +7(3n*— 118n? + 763)/312 
Bog = — (105n* — 6405n* + 91679? — 231491)/34320 
Bos = +7(n?— 1) (n? — 9) (x° — 25) (n? — 49)/329472 
(viii) B,4 = —3(3n2— 73)/17 Bso = + 21(3n* — 150n? + 1307)/680 
Bs, = — (21n* — 1617n*-- 30387n? — 112951)/3536 
Bi, = + 3(105n5 — 11060n* + 334054n* — 2973140n? 


(d) Values o; 


+ 4370361)/3111680 


[e = Zo; Tx (€)] 


(i) aos = (n*—1)/12 
(ii) c = (3n?—7)/20 
(iii) d = (3n?— 13)/14 aoa = (n*— 1) (3n?— 7)/240 
(iv) agg = 5(n?— 7)/18 œs = (9n*— 18n? + 31)/112 
(v) de = 5(3n? — 31)/44 Ong = (Bn* — 50n? + 157)/112 
e = (8n*— 18n? + 31) (n? — 1)/1344 
(vi) ag, = 7(8n*— 43)/52 Og, = 7(15n*— 230n2-+- 1127)/1584 
o4, = (5 55n* + 239? — 381)/960 
(vii) agg = 7(n?— 19)/15 4s = 21 (5n* — 110? + 769)/1144 
css = (5n®— 85n*-- 611n? — 1731)/528 
cos = (5n*— 55n* + 239n? — 381) (n?— 1)/11520 
(viii) og = 3(3n*— 73)/17 oss = 21(3n*— 90n? + 847)/520 
css = 5(21n9— 525n*-- 5635n? — 24187)/6864 
os = (3n$— 52n* + 410n* — 1636n? + 2555)/2816 
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TABLE 7.105 


Numerical values of S,, and By; 


For non-terminating decimals r indicates that the last figure is 
repeated indefinitely; s indicates that the figures 142857 are 
repeated, beginning with the digit immediately before the s 


Soo S1 Sag S33 Boa Bis 
6 17-5 37-3r 64-8 — 2-916r — 5-05 
7 28 84 216 —4 一 了 
8 42 168 594 ー 5-25 — 9-25 
9 60 308 1425-6 ー 6-6r —11-8 
10 82-5 528 3088-8 — 8-25 — 14-65 
11 110 858 6177-6 —10 — 17-8 
12 143 1334-6r 11583 —11-916r — 21-25 
13 182 2002 20592 —14 ` 一 25 
14 227-5 2912 35006-4 — 16:25 — 29-05 
15 280 4125-3r 57283-2 — 18-6r — 33-4 
16 340 5712 90698-4 — 21-25 — 88-05 
17 408 7752 139536 — 24 — 43 
18 484-5 10336 209304 — 26-916r — 48-25 
19 570 13566 306979-2 一 30 — 53-8 
20 665 17556 441282-6 — 33-25 — 59-65 
21 770 22432-6r 622987-2 ー 36-6r — 65-8 
22 885-5 28336 865260 — 40-25 ー 72-25 
23 1012 35420 1,184040 —44 —79 
24 1150 43853-3r 1,598454 —47-916r — 86-05 
25 1300 53820 2,131272 ー 52 — 93-4 
26 1462-5 65520 2,809404 — 56-25 — 101-05 
27 1638 79170 3,664440 — 60-6r — 109 
28 1827 95004 4,733235 — 65-25 — 117-25 
29 2030 . 113274 6,058540-8 一 70 — 125-8 
30 2247-5 134250-6r 7,689686-4 — 74-916r — 134-65 
31 2480 158224 9,683308-8 — 80 — 143-8 
32 2728 185504 12,104136 — 85-25 — 153-25 
33 2992 216421-3r 15,025824 — 90-6r — 163 
34 3272-5 251328 18,531849-6 — 96-25 ー 173-05 
35 3570 290598 22,716460-8 — 102 — 183-4 
36 3885 334628 27,685686-6 —107-916r 一 194・05 
37 4218 383838 83,558408 —114 — 205 
38 4569-5 438672 40,467492 — 120-25 — 216-25 
39 4940 499598-6r 48,560990-4 — 126-6r — 227-8 


40 5330 567112 58,003405-2 — 133-25 — 239-65 


S81 


5740 
6170:5 
6622 
7095 
7590 


8107-5 
8648 
9212 
9800 
10412-5 


11050 
11713 
12402 
13117-5 
13860 


14630 
15428 
16254-5 
17110 
17995 


18910 
19855-5 
20832 
21840 
22880 


23952-5 
25058 
26197 
27370 
28577-5 


29820 
31098 
32412 
33762-5 
35150 


7.10 TABLES 


TABLE 7.10b (cont.) 


822 


641732 
72400531 
814506 
913836 
1.022626 


1.141536 
1.271256 
1.412506 61 
1,566040 
1,732640 


1,913123-3r 
2,108340 
2,319174 
2,546544 
2,791404 


3,054744 
3,337590-6r 
3,641008 
3,966098 
4,314001-3r 


4,685898 
5,083008 
5,506592 
5,957952 
6,438432 


6,949418-6r 
7,492342 
8,068676 
8,679939-3r 
9,327696 


10,013556 
10,739176 
11,506260 
12,316560 
13,171876-6r 


S33 


68,977022-4 
81,683316 
96,344424 

113,204698-2 

132,532329-6 


154,621051-2 
179,791920 
208,395180 
240,812208 
277,457544 


318,781008 
365,269905 
417,451320 
475,894504-8 
541,213358-4 


614,069002-8 
695,172456 
785,287404 
885,233073-6 
995,887207.8 


1118,189145-6 
1253,143008 
1401,820992 
1565,366774-4 
1744,999027-2 


1942,015046-4 
2157,794496 
2393,803269 
2651,597467-2 
2932,827501-6 


3239,242315-2 
3572,693730 
3935,140920 
4328,655012 
4755,423816 


Pos 


—140 
— 146-9161 
— 154 

— 161-25 
—168-6r 


一 176.25 
—184 
ー191・916r 
— 200 


— 290 
— 299-916r 


—310 
一 320.25 
— 330-6r 
—341-25 
一 352 


一 362.916r 
一 374 

— 385-25 
— 396-6r 
—408-25 


—420 
— 481-9168r 
— 444 
—456-25 

— 468-6r 


229 


Pis 


— 251-8 
— 264-25 
— 277 

— 290-05 
— 303-4 


— 317-05 
— 331 

— 345-25 
— 359-8 
— 374-65 


— 389-8 
— 405-25 
— 421 

—437:05 
—453-4 


— 470-05 
— 487 

— 504-25 
— 521-8 
— 539-65 


— 557-8 
— 576-25 
—595 

— 614-05 
— 633-4 


— 653-05 
— 673 

— 693-25 
一 713.8 
— 734-65 


— 755:8 
ー777.25 
一 799 

— 821-05 
— 843-4 
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TABLE 7.105 (cont.) 


524 


8228 — 6-788 十 5.0625 
452-5s 一 9.5s 十 10.2s 


1810-2s — 12・78s 十 18・5625 
5883・4s ー 16-4s + 30-8s 
16473-6 ー 20-5 + 48-2625 


41184 一 25 十 72 

94134-8s — 29-92s + 103-41964s 
200036-5s 一 35.2s 十 144 
400073-1s —41-07s +195-34821s 
760138-97s —47-2s + 259-2 


1,382070-8s — 53-92s + 337-41964s 
2,418624 —61 +432 
4,093056 — 68-5 + 545-0625 
6,724306-2s ー 76-48 + 678-8s 
10,758890-05s — 84-78s + 835-7625 


16,810765-7s — 93-5s + 1018・2s 
25,710582-8s — 102-78s + 1229-0625 
38,565874-2s —112-4s +1470-8s 
56,833920 — 122-5 + 1746-5625 
82,409184 —133 + 2059-2 


117,727405-7s — 143-928 + 2411-91964s 
165,888617-1s ー 155-2s + 2808 
230,801554-2s — 167-07s + 3250-84821s 
317,352137-1s — 179-2s + 3744 
431,598906-51s ー 191-92s 4-4291-11964s 


580,998528 — 205 + 4896 

774,664704 — 218-5 + 5562-5625 
1023,664073-1s — 232-4s + 6294-8s 
1341,352923-4s — 246-78s 4- 7097-0625 
1743,758800-45s 一 261-5s + 7973-48s 


2250,011355-4s — 276-788 + 8928-5625 
2882,827049-1s — 292-4s + 9966-8s 
3669,052608 — 308-5 4- 11093-0625 
4640,272416 —325 + 12312 


5833,485322-97s — 341-92s 4-13628-61964s 
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TABLE 7.10b (cont.) 


7291,856653-7s ー 359-2s + 15048 
9065,551515-4s — 377-07s + 165775:34821s 
11212,655821-7s — 395 ·28 + 18216 
13800, 19178058 —413-92s + 19975-41964s 
16905,234931-2 — 433 +21859-2 


20616,140160 — 452-5 + 23873-0625 
25033,884480 — 4712-48 4- 26022-8s 
30273,534720 — 492-78s + 28314-5625 
36465,848640 ー513・3s + 30754・2s 
43759,018368 — 534-785 4- 33348-2625 


52320,565440 —556-4s 4- 36102-8s 
62339,397120 一 578.5 + 39024-5625 
74028,034080 — 601 +42120 
87625,019931-4s ー 623-92s 4- 45395-91964s 
103397,523519-08s ー 647-2s + 48859-2 


or 


ano Ci 
Oe o y om 


121644,145316-5s ー 671-07s + 52516-84821s 
142697,939698-2s ー 695-2s + 56376 
166929,665307-4s ー 719・92s + 60443-91964s 
194751,276192 ー 745 + 64728 
226619,666841-6 一 770.5 + 69235-7625 


C tt 
o t0) -10 


Ona 


263040,684726-8s ー 796・4s +73974-8s 
304573,424420-5s ー 822-78s + 18953-0625 
351834,817865-1s — 849-5s + 84178-2s 
405504,535844-5s — 876-78s + 89658-5625 
466330,216221-25s — 904-4s + 95402-05s 


535133.035008 — 932-5 +101417-0625 
612813,636864 — 961 4-107712 
700358,442130-2s — 989-92s +114295-41964s 
798846,348054-8s —1019-2s +121176 
909455,842400-91s — 1049-07s + 128362-54821s 


3472,548182-8s — 1079-2s 4-135864 
2297,218834-2s — 1109-92s + 143689-41964s 
7454,203680 —1141 7-151848 
0600,404160 —1172-5 --160349-0625 
3534,741837-7s —1204-4s + 169202058 


,0 
3 


1 
1, 
1, 
1 
1 


3 
7 
2 
0 
9 


1 
5 
6 


, 
, 
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TABLE 7.106 (cont.) 

n Sss Pas Bis 

6 57・1s 一 8.05r +11-47519841 (479/1008) 

7 685-7s ー11・6r 4-24-95238095 (20/21) 

8 4457-1s —15-83r 4-46-75297619 (253/336) 

9 20800 — 20-5r 十 79.5r {5/9) 
10 78000 ー25・83r 4-126-39583r (19/48) 
11 249600 —31:6r + 190-6r (2/3) 
12 707200 一 38.05r 十 276.11805r (17/144) 
13 1,818514-2s —45 + 386:8s (6/7) 
14 4,318971-4s — 52-5 + 527-34821s (117/336) 
15 9,597714-2s — 60-5r + 702-4126984 (26/63) 
16 20,155200 — 69-16r 4-917:22916r (11/48) 
17 40,310400 ー 78-3r +1177-3r (1/3) 
18 77,261600 — 88-05r --1488-61805r (89/144) 
19 142,636800 — 98-3r + 1857・3r (1/3) 
20 254,708571-4s — 109-16r --2290-086310 (29/336) 
21 441,494857-1s 一 120.5r 十 2793.841270 (53/63) 
22 745,022571-4s — 132-5 十 3375.91964s (103/112) 
23 1227,096000 —145 +4044 
24 1976,988000 —158-05r +4806-11805r (17/144) 
25 3121,560000 —171:6r 十 5670.6r (2/3) 
26 4838,418000 一 185.83r 十 6646.39583r (19/48) 
27 7372.827428・5s ー 200・5r +7742-412698 (26/63) 
28 11059,241142-8s ー 215・83r + 8968-181548 (61/336) 
29 16348,443428-5s ー 231-6r + 10333-52381 (11/21) 
30 23841,480000 — 248-05r +11848-61805r (89/144) 
31 34331,731200 — 265 +13524 
32 48856,694400 — 282-5 + 15370-5625 (9/16) 
33 68761,273600 — 300-5r --17399-5r (5/9) 
34 95774,631085-7s — 319-16r -- 19622-58631 (197/336) 
35 132102,939428-5s — 338:3r 4- 22051-61905 (13/21) 
36 180540,683885-7s ー358・05r 4- 24698-97520 (983/1008) 
37 244603,507200 一 378.3r +27577-3r (1/3) 
38 328685,962800 — 399-16r + 30699-72916r (35/48) 
39 438247,950400 — 420-5r + 34079-5r (5/9) 
40 580034,052000 — 442-5 --37730-5625 (9/16) 
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TABLE 7.105 (cont.) 


Sss 


762330,468342-8s 

995264,778114-2s 
1,291154,306742-8s 
1,664909,500800 
2,134499,360000 


2,721486,684000 
3,451641,648000 
4,355643,032000 
5,469877,296000 
6,837346,620000 


8,508698,016000 
10,543386,672000 
13,010987,808000 
15,992672,514000 
19,582864,302857-1s 


23,891094,449485-7s 
29,044075,605257-1s 
35,188014,675600 
42,491187,532800 
51,146799,808000 


61,376159,769600 

73,432191,152914-2s 

87,603315,761371-4s 
104,217737,716114-2s 
123,648163,392000 


146,316993,347200 
172,702024,934400 
203,342706,777600 
238,846988,913371-4s 
279,898815,132857-1s 


327,266306,924571-4s 
381,810691,412000 
444,496028,808000 
516,399798,174000 
598,724403,680000 


Bas 


— 465 

— 488-05r 
— 511・6r 
— 535-83r 
— 560-5r 


— 585-83r 
ー 611・6r 
ー 638-05r 
ー 665 

ー 692-5 


ー 720・5r 
ー 749-16r 
ー 778-3r 
ー 808-05r 
ー 838-3r 


ー 869・16r 
ー 900・5r 
— 932-5 
— 965 

— 998-05r 


ー1031-6r 
— 1065-83r 
—1100-5r 
—1135-83r 
ー 1171-6r 


ー1208-05r 
—1245 
—1282-5 
—1320-5r 
— 1359-16r 


— 1398-3r 
— 1438-05r 
—1478-3r 
—1519-16r 
ー1560・5r 


Bis 


+ 41666-8s 

+ 45902-90377 
+ 50453-52381 
+ 55333-89583r 
+ 60559・5r 


+ 66146-39583r 
+ 72110-6r 

+ 78468-97520 
+ 8523828 

+ 92435-91964s 


+ 100079-dr 

+ 108187-22916r 
+116777-3r 

+ 125868-61805r 
+ 135480-1905 


+ 145631-5149 
+ 156342-4127 
+ 167633-0625 
+179524 
+192036-11805r 


+ 205190-6r 
+ 219009-2530 
+ 233513-8413 
+ 248726-7530 
+264670-6r 


+ 281368-61805r 
+298844 
+317120-5625 
+336222-4127 
+356174-0149 


+377000-1905 
+398726-11805r 
+421377-3r 
+444979-72916r 
+ 469559-5r 
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(6/7) 
(911/1008) 
(11/21) 
(43/48) 
(5/9) 


(19/48) 
(2/3) 
(983/1008) 
(2/7) 
(103/112) 


(5/9) 
(11/48) 
(1/3) 
(89/144) 
(4/21) 


(173/3360) 
(26/63) 
(1/16) 


(17/144) 


(2/3) 
(85/336) 
(53/63) 
(253/336) 
(2/3) 


(89/144) 
(9/16) 


(26/63) 
(5/336) 


(4/21) 
(17/144) 
(1/3) 
(35/48) 
(5/9) 
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to 
HS 
— 


= b — ° — tom toe bo — L° — L° — tS — tS — tbt — 1 — 1 — Wor 19 — LŠ 


do — Lo = t 


TABLE 7.10c 
The coefficients Bij 


Bos 


— 4:375 

—4 

— 5:25 
—20 

— 4:125 


— 323-75 
—114 

— 60-125 
一 380 
— 133-25 


B33 
1-6r 
0-16r 
0-6r 
0-83r 
1・6r 


0-83r 
0-6r 
0-16r 
1-6r 
0-83r 


3・3r 
0-16r 
0-3r 
0-83r 
3.3r 


0-83r 
0-3r 
0-16r 
3-3r 
0-83r 


1-6r 
0-16r 
0-6r 
0-83r 
1・6r 


0-83r 
0-6r 
0-16r 
1-6r 
0-83r 


3-3r 
0-16r 
0-3r 
0-83r 
3.3r 


Bis 


— 8-416r 
— 1:16r 
— 6:16r 
ー 9-83r 
—24-416r 


ー 14-83r 
— 14-16r 
—4-16r 
— 48:416r 
一 27.83r 


一 126.83r 
—7-16r 
— 16-083r 
—44-83r 
—198-83r 


ー 54-83r 
— 24-083r 
— 13-16r 
— 286-83r 
一 77-83r 


一 168.416r 
ー18-16r 
ー 78・16r 

ー 104-83r 

ー 224-416r 


—119-83r 
一 102.16r 
一 27.16r 
一 288.416r 
一 152.83r 


— 646-83r 
ー 34-16r 
ー 72・083r 

ー 189-83r 

ー 798・83r 
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TABLE 7.10c (cont.) 


MS 
— 


1 0-S3r — 209-83r 
2 0・3r ー 88-083r 
1 0-16r — 46-16r 
3 3.3r — 966-83r 
1 0-83r — 252-83r 


2 1・6r — 528-416r 
1 0-16r — 55-16r 
2 0-6r — 230-16r 
1 0-83r — 299-83r 
2 — 624-416r 


1 3 0-83r — 824-83r 
2 1 — 225-25 0-6r ー270-16r 
1 1 — 234 0-16r —70-16r 
2 1-5 — 364-375 1-6r ー 728・416r 
1 1 — 252 0-83r 一 377.83r 


2 1 — 261-25 3・3r — 1566-83r 
1 3 ー 812 0-16r — 81:16r 
2 0-5 — 140-125 0-3r — 168-083r 
1 1 一 290 0-83r ー 434-83r 
2 3 — 899-75 —1798-83r 


1 1 —310 0-83r — 464-83r 
2 0-5 — 160-125 0-3r — 192-083r 
1 3 — 992 0-16r — 99-16r 
2 1 — 341-25 3・3r ー 2046-83r 
1 1 ー352 0-83r ー 527-83r 


2 1-5 — 544-375 1-6r — 1088-416r 
1 1 —374 0-16r —112-16r 
2 1 — 385-25 0-6r — 462-16r 
1 3 — 1190 0・83r ー 594・83r 
2 0・5 — 204-125 ー 1224-416r 


1 1 — 420 0-83r ー 629-83r 
2 3 ー 1295-75 0-6r —518-16r 
1 1 — 444 0-16r — 133-161 
2 0-5 — 228-125 1・6r — 1368-416r 
1 3 — 1406 一 702.83r 
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1-4583r 


0-583r 
0-583r 
0-583r 
0-083r 
0-416r 


0-583r 
0-583r 
0-2916r 
0-583r 
2-916r 


0-083r 
0-083r 
0-583r 
0-583r 
2-916r 


0-2916r 


0-583r 
0-083r 
0.083r 
2-916r 


TABLE 7.10c (cont.) 


Boa 
— 3-9583r 
— 5-583r 
一 7.4583r 
一 9.583r 
一 8.5416r 


— 20831 
— 8.729161 
— 20-5831 
— 23-9583r 
— 137-9161 


ー 31-4583 
— 5-083 
— 570831 

— 44-5831 

— 123-64583r 


— 54-583r 
— 59-9583 
— 65-5831 
— 1020831 
ー 55-41 r 


— 83-9583r 

ー 90-5831 

— 48-7291 r 
— 104-5831 
ー 559-7916 


— 17-083 

— 18-2083r 
— 135-5831 
— 143-9583r 
ー 762-9161 


— 80-72916r 
— 170-583 

— 25-7083 

— 27.0831 
— 997.2916 


Poa 


十 2.953125 . 


十 18 
+ 20-109375 


+6 
+30-1640625 
+84 
+113-953125 
+756 


+ 196-828125 
+36 
+ 45-421875 
+396 
+ 1218・8203125 


+594 
+716-953125 
+858 
+ 145-546875 
+858 


+ 1406-953125 
+1638 
+948-1640625 
+2184 
+ 12515-765625 


+408 
+ 463-546875 

+3672 
+ 4139-953125 

+ 23256 


+ 2604-1640625 
+5814 
+924-421875 
+1026 
+ 39750-140625 


Bia 
0-583r 


0-583r 
0-583r 


0-416r 


0-083r 
0-583r 
0-583r 
0-583r 
2-916r 


0-583r 


0-083r 
0-583r 
2-916r 


0-583r 
0-583r 
0-583r 
0-083r 


0-583r 
0-583r 
0-583r 
0-583r 
2-916r 


0-083r 
0-083r 


0-583r 
2-916r 


0-583r 
0-583r 
0-083r 
0-083r 
2-916r 


0・2916r 


0-0416r 


0-2083r 


0-2916r 
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TABLE 7.10c (cont.) 


Boa 
— 209-583r 
— 219-9583r 
— 230-583r 
— 120-72916r 
— 180-416r 


—37-7083r 
— 275-5831 
— 287-4583r 
— 299-583r 

— 1559-7916r 


— 324-583r 
— 24-10416r 
ー 50-083r 

— 363-9583r 

— 1887-916r 


ー 391-4583r 

— 405-583r 

— 419-9583r 
— 62-083r 

— 160-52083r 


— 464-583r 
ー 4'19-9583r 
— 495-583r 
— 511-4583r 
— 2637-916r 


ー 77-7083r 
— 80-083r 
— 288-72916r 
— 594-583r 
ー3059・7916r 


ー 629-583r 

ー 647-4583r 
— 95-083r 

— 97-7083r 

— 3512-916r 


we 
e 
—1 


Boa 
+8778 
+ 9668-953125 
+ 10626 
+ 5826-1640625 
+9108 


+ 1989-421875 
+15180 
+ 16516-828125 
+ 17940 
+ 97265-765625 


+ 21060 
+ 1626-0234375 
+3510 
+ 26480-953125 
+ 142506 


+30634-828125 

十 32886 

十 35258.953125 
十 5394 

十 14424.1171875 


+43152 
+46055:953125 
+49104 
4-52300-828125 
4-278256 


十 8451・421875 
+8976 
+ 33336-1640625 
+ 70686 
+ 374390-765625 


+ 79254 

+ 83818-828125 

+ 12654 

+ 13362-421875 
+ 493506 
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TABLE 7.10c (cont.) 


Bss 
— 16-916r 
— 4-083r 
一 11.083r 
一 3.083r 
一 2.583r 


ー0-7916r 
—5:7083r 
— 2-625 
ー 12-25 
ー 63-583r 


— 6:916r 

—3:916r 
— 26:416r 

— 2-4583r 
— 38-2083r 


— 63-2916r 

— 30-916r 
一 2.416r 

一 47.416r 
一 8.583r 


一 18.583r 
一 105.2916r 
—'15:5416r 
— 40-5416r 
—'14-416r 


—4-416r 

ー 9・416r 

— 45-083r 

— 223-416r 
— 59-2083r 


一 375-9583r 
— 9-4583r 
— 39-916r 
— 63-083r 
— 14-75 
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Bis 


-F24-097916r 
十 8.73r 

十 32.727083r 

+11-93r 

+ 12-639583r 


+4-76r 
+ 41:4177083r 
+ 22-56r 
+ 123-047916r 
+ 737-53r 


+91-722916r 
+ 58-86r 
+446-585416r 
十 46.43r 
十 801.5302083r 


十 1466.76r 
+ 787-714583r 
+67-4 
+ 1441-835416r 
+ 283-53r 


+ 664-639583r 
+4064-76r 
+ 3138-8635416r 
+ 1808-36r 
+ 3554-58541 6r 


+ 225-4 
+ 512-352083r 
+ 2609-93r 
+13735-810416r 
+ 3859-03r 


+ 25933-9239583r 
+ 689-43r 
+ 3069-972916r 
+5111-93r 
+ 1257-685416r 
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TABLE 7.10c (cont.) 


Pss 


— 54:25 

— 1024-916r 
— 89-5416r 
— 26-7916r 
— 42-0416r 


ー 58-5S3r 
ー 30-583r 
—1339-916r 
一 77.583r 
一 161.583r 


—54-0416r 

一 37.4583r 

— 19-4583r 
— 242-416r 
— 293-416r 


— 608-416r 

— 945・5S3r 

— 31-0831 
— 8-0416r 
— 149-7083r 


一 25.7916r 
— 746-083r 
— 1155-5831 
ー 795-0831 
— 58-5831 


— 362-4161 
— 10-375 
— 21-375 
ー 693-2916 
— 951-4161 


— 489-416r 
— 431-4161 
— 73-916 
— 151-9161 
— 117-0416r 


Bis 
+ 4861-13r 
+ 96396-0979 16r 
+ 8829-36r 
4-2766-6947916r 
+4541-96r 


+ 6614-639583r 
+ 3605-53r 
+ 164784-847916r 
+ 9944-46r 
+ 21568-38125 


+ 7505-96r 

+ 5409-3614583r 

+2919-43r 
+37760-585416r 
+ 47418-06r 


+ 101942-060416r 
+ 164159-53r 
+ 5587-76875 
+ 1496-03r 
+ 28805-4177083r 


+5129-76r 
+ 153306-477083r 
+ 245189-53r 
+ 174108-727083r 
+ 13233-53r 


+ 84410-585416r 
+ 2490-36r 
+5285-3427083r 

+176516-76r 
+ 249321-810416r 


+131950-06r 
+119617-835416r 
+ 21068-86r 
+ 44497-972916r 
+ 35216-96r 
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TABLE 7. Iod 


The coefficients Bi 


r indicates that the last figure is repeated; s that the set 142857 
is repeated; t that the decimal is & fraction of 21 


Bun Bross Bras) Ban Bros) 
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TABLE 7.10d (cont.) 


Btozi 


198-3r — 1963-5 
— 35 210 —102 714 — 2142 
— 36 222 — 105 756 —2331 
一 37 234-3r — 108 799-2 — 2530-8 
247 — 2741-7 


260 — 2964 


— 40 273-3r —117 936 — 3198 
—41 287 —120 984 — 3444 
—42 301 — 123 1033-2 — 3702-3 


315-3r — 3973-2 


330 — 4257 
— 45 345 — 132 1188 — 4554 

—46 360-3r —135 1242 — 4864-5 
— 47 376 —138 1297-2 — 5188-8 
392 — 5527-2 


408-3r — 5880 


— 50 425 — 147 1470 — 6247-5 
—51 442 —150 1530 — 6630 
— 52 459-3r — 153 1591-2 ー 7027-8 


477 — 7441-2 


495 — 7870-5 
— 55 513-3r — 162 1782 — 8316 
— 56 532 — 165 1848 — 8778 
— 57 551 —168 1915-2 — 9256-8 
570-3r — 9752-7 


590 — 10266 
— 60 610 —177 2124 — 10797 
— 61 630-3r — 180 2196 — 11346 
— 62 651 — 183 2269-2 —11913-3 
672 — 12499-2 


693-3r — 13104 
— 65 715 — 192 2496 — 13728 
— 66 737 — 195 2574 — 14371-5 
— 67 759-3r — 198 2653-2 — 15034-8 
782 — 15718-2 


— 69 805 — 204 2815-2 — 16422 
— 70 828-3r — 207 2898 — 17146-5 
一 71 852 — 210 2982 —17892 
— 72 876 — 213 3067-2 ー 18658-8 


900-3r — 19447-2 


17 
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TABLE 7.10d (cont.) 


Brosi 
+ 5:1s 


+ 15・4S 
+30-8s 
4- 51・4s 
＋ 77· Is 
+108 


+144 

十 185.1s 
十 231.4s 
十 282.8s 
+339-4s 


4-401:1s 
4-468 
4-540 
十 617.1s 
十 699.4s 


十 786.8s 
+879-4s 
土 977・1s 
+ 1080 
+ 1188 


+ 1301-1s 
+ 1419-4s 
+ 1542-8s 
+ 1671・4s 
+ 1805-1s 


+ 1944 
+ 2088 
+2237-1s 
+2391-4s 
+ 2550-8s 


+ 2715 · 48 
+ 288518 
+ 3060 
+ 3240 
+ 3425・1s 


Bra 
— 1-78 


— 6-8s 
—17-1s 
—34-2s 
— 60 
— 96 


— 144 

— 205-7s 
— 282-8s 
ー377-1s 
ー490・2s 


— 624 

— 780 

— 960 
— 1165-7s 
— 1398-8s 


— 1661・1s 
— 1954・2s 
— 2280 
— 2640 
— 3036 


— 3469-78 
ー 3942・8s 
— 4457- 1s 
ー 5014-2s 
— 5616 


— 6264 
— 6960 
ー 7705-78 
— 8502-8s 
— 9353・1s 


— 10258-2s 
— 11220 
— 12240 
— 13320 
ー 14461-7s 


十 0.34s 


+1-7s 
十 5.1s 
+12 
+24 
+ 43:2 


十 72 
十 113.1s 
+169-7s 
4-245-1s 
4-343-2 


+468 
+624 
+816 
十 1049-1s 
+1328-91s 


+1661-1s 
+2052 

+ 2508 
+3036 

+ 3643-2 


+4337-1s 
+ 5125-78 
4- 6017・1s 
4-7020 

+ 8143-2 


+ 9396 
+ 10788 
+ 12329-1s 
-+ 14029-7s 
4-15900-34s 


4- 17952 
4- 20196 
4- 22644 
+ 25308 
4- 28200-34s 


に そり | 
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TABLE 7.10d (cont.) 


Brea 


4- 3615・4s 
+ 3810・Ss 
十 4011-34s 
+ 4217・1s 
+ 4428 


+ 4644 

+ 4865-1s 
+ 5091-4s 
+ 5322-8s 
+ 5559-4s 


十 5801'1s 
十 6048 
十 6300 
+ 6557・1s 
+ 6819・4s 


十 7086.8s 
+ 7359-4s 
+ 7637・1s 
+ 7920 
+ 8208 


十 8501.1s 
十 8799・4s 
+ 9102-8s 
十 9411・4s 
+ 9725・1s 


十 10044 
+ 10368 
+ 10697-1s 
+11031-4s 
+11370-8s 


+11715-4s 
+12065-1s 
+ 12420 
+12780 
+13145-1s 


— 15666-8s 
— 16937-1s 
—18274-2s 
— 19680 
— 21156 


— 22704 

— 24325-7s 
— 26022-8s 
ー27797・1s 
— 29650-2s 


— 31584 
— 83600 
— 35700 
ー 37885-7s 
— 40158-8s 


ー 42521-1s 
— 44974˙28 
— 47520 
— 50160 
— 52896 


— 55729 ·78 
— 58662-8s 
— 61697-1s 
— 64834-2s 
— 68076 


— 71424 
— 74880 
ー 78445-7s 
— 82122-8s 
— 85913-1s 


— 89818-2s 
— 93840 
— 97980 
— 102240 
ー106621・7s 


+ 31333・7s 
+ 34721・1s 
+ 38376 

+ 42312 

十 46543.2 


4-51084 

+ 55949-1s 
4-61153-7s 
+ 66713-1s 
十 72643.2 


十 78960 

十 85680 

+ 92820 
4-100397-1s 
+108428-91s 


+ 116933-1s 
+ 125928 

+ 135432 

+ 145464 
4-156043-2 


+ 167189-1s 
+178921-7s 
+191261-1s 
+ 204228 
4-217843-2 


4-232128 

+ 247104 

+ 262793-1s 
+279217-7s 
+ 296400-34s 


+314364 
+ 333132 
+ 352728 
+ 373176 
+394500-34s 
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Prss 


十 26-6r 
十 80 
十 160 
+ 266-6r 
+ 400 


+560 
+ 746-6r 
+ 960 

+ 1200 

+ 1466-6r 


+1760 
+2080 
+ 2426-6r 
+2800 
+3200 


+3626-6r 
+4080 
+4560 
+ 5066-6r 
+ 5600 


+6160 
+ 6746-6r 
+ 7360 
+8000 
+ 8666-6r 


+9360 
+ 10080 
+ 10826-6r 
+ 11600 
+ 12400 


+ 13226-6r 
+ 14080 
+ 14960 
+ 15866-6r 
+ 16800 


TABLE 7.10d (cont.) 


Bt 281 


— 10 
— 40 
— 100 
— 200 
— 350 


— 560 
— 840 
— 1200 
—1650 
— 2200 


— 2860 
— 3640 
— 4550 
— 5600 
— 6800 


— 8160 
— 9690 
— 11400 
— 13300 
— 15400 


— 17710 
— 20240 
— 23000 
— 26000 
— 29250 


— 32760 
— 36540 
— 40600 
— 44950 
— 49600 


— 54560 
— 59840 
— 65450 
— 71400 
— 77700 


Bras 


+2-8s 

+14-2s 

+ 42-8s 
+100 
+200 


+360 

+600 

十 942・8s 
+ 1414-2s 
+ 2042-8s 


+ 2860 
+ 3900 
+ 5200 
+ 6800 
+8742-8s 


+11074-2s 
+13842-8s 
+ 17100 
+ 20900 
+ 25300 


+ 30360 
+36142-8s 
十 42714-2s 
+ 50142-8s 
+ 58500 


+ 67860 

+ 78300 

+ 89900 
+ 102742-8s 
+116914-2s 


+ 132502-8s 
+ 149600 
+ 168300 
+188700 
+ 210900 


Brosi 


— 0-476190t (10/21) 
— 2-8s 

— 10 

— 26-6r 

— 60 


— 120 
— 220 
ー377・1s 
ー 612-8s 
ー 953・3r 


— 1430 
— 2080 
— 2946-6r 
— 4080 
ー 5537・1s 


ー 7382・8s 
— 9690 
— 12540 
— 16023-3r 
— 20240 


— 25300 

— 31323-809523t (17/21) 
ー 98442-8s 

— 46800 

— 56550 


— 67860 

— 80910 

— 95893-3r 
—113017-1s 
— 132502-8s 


— 154586-6r 
— 179520 
— 207570 
— 239020 
— 274170 


51 
52 
53 
54 
55 


56 
57 
58 
59 
60 


61 
62 
63 
64 
65 


66 
67 
68 
69 
70 


71 
72 
73 
74 
75 


Basi 


— 2160 
— 2220 
— 2280 
— 2340 
— 2400 


— 2460 
— 2520 
— 2580 
— 2640 
— 2700 


— 2760 
— 2820 
— 2880 
— 2940 
— 3000 


— 3060 
—3120 
— 3180 
— 3240 
— 3300 


— 3360 
— 3420 
—3480 
— 3540 
— 3600 


— 3660 
— 3720 
— 3780 
— 3840 
— 3900 


— 3960 
— 4020 
— 4080 
—4140 
— 4200 


81351 


＋ 17760 
+18746-6r 
+ 19760 
+ 20800 
+ 21866-6r 


+ 22960 
+ 24080 
+ 25226-6r 
+ 26400 
+ 27600 


+ 28826-6r 
+ 30080 
+31360 
+ 32666-6r 
+ 34000 


+ 35360 
+ 36746-6r 
+38160 
+39600 
+41066-6r 


+42560 
+44080 
+ 45626-6r 
+47200 
+ 48800 


+50426-6r 
+ 52080 
+ 53760 
+ 55466-6r 
+ 57200 


+ 58960 
4- 60746-6r 
4- 62560 
+ 64400 
4- 66266-6r 
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TABLE 


Bios; 


— 84360 
— 91390 
— 98800 
— 106600 
— 114800 


— 123410 
— 132440 
— 141900 
— 151800 
— 162150 


— 172960 
— 184240 
— 196000 
— 208250 
— 221000 


— 234260 
— 248040 
— 262350 
— 277200 
— 292600 


— 308560 
— 325090 
— 342200 
— 359900 
— 378200 


— 397110 
—416640 
— 436800 
— 457600 
— 479050 


— 501160 
— 523940 
— 547400 
— 571550 
— 596400 


7.10 (cont.) 


Bas 


+ 235002-8s 
+261114-2s 
+ 289342-8s 
+319800 
+ 352600 


+ 387860 
+ 425700 
+466242-8s 
+ 509614-2s 
+ 555942-8s 


+ 605360 
+ 658000 
+ 714000 
+ 773500 
+ 836642-8s 


+903574-2s 
+974442-8s 
+1,049400 
+ 1,128600 
+1,212200 


+1,300360 
+ 1,393242-8s 
+1,491014-2s 
+ 1,593842-8s 
+1,701900 


+ 1,815360 
+ 1.934400 
+ 2,059200 
+ 2,189942-8s 
+ 2,326814-?s 


+ 2,470002-8s 
+2,619700 
+ 2.776100 
+ 2,939400 
+ 3,109800 
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Bros: 


— 313337-1s 

— 356856-190476t (4/21) 
— 405080 

— 458380 

— 517146-6r 


— 581790 
— 652740 
ー 730447・1s 
— 815382-8s 
— 908040 


— 1,008933-3r 
— 1,118600 
— 1,237600 
— 1,366516-6r 
— 1,505957-1s 


— 1,656552-8s 
— 1,818960 
—1,993860 
— 2,181960 
— 2,383993-3r 


— 2,600720 

— 2,832927-1s 

— 3,081429-523809t (11/21) 
— 3,347070 

— 3,630720 


— 3,933280 

— 4,255680 

—4,598880 
—4,963870-476190t (10 21) 
— 5,351672-8s 


— 5,763340 
— 6,199956-6r 
— 6,662640 
— 1,152540 
— 7.670840 
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TABLE 7.10e 


Formulae for the factorial coefficients Birs 


Zero degree 


Bro = 1 
lst degree 
Ban = 1 


Bion = — (m — 1)/2 
2nd degree 
Bin) = 2 


Bua = — (n — 2) 
Broo) = + (n — 1) (n — 2)/6 


3rd degree 


Biss) = 6 
Blas = —3(n— 3) 
Bus = + 3(n— 2) (n 3/5 


Bios; = — (n— 1) (n—2) (n — 3)/20 
4th degree 

Bua = 24 

Bisa = —12(n-— 4) 


Biza = + 18(n — 3) (n — 4)/7 
Bua = — 2(n — 2) (n — 3) (n — 4)/7 
Btoa! = + (n — 1) (n — 2) (m — 3) (n — 4)/70 


5th degree 


Biss = 120 

Bus = — 60(n — 5) 

Bias) = +40(n — 4) (n—5)/3 

Blas: = — 5(m — 3) (n 4) (n — 5)/3 

Bas = + 5(m— 2) (n — 3) (n—4) (n — 5)/42 

Bios: = — (n— 1) (n—2) (n— 3) (n—4) (n — 5)/252 


te 
りう 
- 
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TABLE 7.10f 


Formulae for $¢ 573 


Zero degree 


tool = Win 
lst degree 
$uo = Wu 


hun = 2Wa t+ Win 


2nd degree 

の so = Wee} 

の rs = 3W.əi + 221 

P22) = 6W.a+ 6W.si + Wo) 


3rd degree 

$130) = Ws; 

の rs = fW. + 3W3; 

Gig = 101; + 12W p + 395; 


$n = 20Wt T 30 F 12W; a + Wia 
4th degree 
只 ao = Wa 


brary = 5Wisy + 4Wia 
Pian = 15W. i+ 20W,, + 6Wia 


Pras) = 35W,2)+ 60W,, + 30M 5) + 4Wra 

Qua) = TOW) + 140W,,; + 90W i) + 20K 5) + May 
5th degree 

disor = Wis 


$i = 6Wig + 5W:s; 

Pisa = 21Win + 30W. 1 + 10M, 

Pisas = 06Wig; + 105W;7) + 60W;q; + 10W;;; 

Pisa = 126% + 280W;,; + 210W,;; + 60W,, + 5Wis; 

ss) = 252 N10 + 630W.; + 560W,, 210% + 30W,,, + Wis; 
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TABLE 7.10g 


ç 
Sums Ta of the powers xi 


105625 


123201 
142884 
164836 
189225 
216225 


z=0 


1 

17 
98 
354 
979 


2275 
4676 
8772 
15333 
25333 


39974 
60710 
89271 
127687 
178312 


243848 
327369 
432345 
562666 
722666 


917147 
1,151403 
1,431244 
1,763020 
2,153645 


2,610621 
3,142062 
3,756718 
4,463999 
5,273999 


1 

33 
276 
1300 
4425 


12201 
29008 
61776 
120825 
220825 


381876 
630708 
1,002001 
1,539825 
2,299200 


3,347776 
4,767633 
6,657201 
9,133300 
12,333300 


16,417401 
21,571033 
28,007376 
35,970000 
45,735625 


57,617001 
71,965908 
89,176276 
109,687425 
133,987425 


1 

65 
794 
4890 
20515 


67171 
184820 
446964 
978405 

1,978405 


3,749966 
6,735950 
11,562759 
19,092295 
30,482920 


47,260136 
71,397705 
105,409929 
152,455810 
216,455810 


302,221931 
415,601835 
563,637724 
754,740700 
998,881325 


1307,797101 
1695,217590 
2177,107894 
2771,931215 
3500,931215 


249 


CHAPTER 8 


STANDARD DEVIATIONS OF THE 
ESTIMATES 

81 FORMULAE FOR VARIANCES 

Since the estimate 
à; — iw. Toy w T) = ZW er,) Yal Si; 

is a linear function of the observations y;, 

vara, = > Ë er,) £ w; Tj) | var Vio 

i i 
and as var y; = o7/w,, 
var a, u. T3(x;) = c*/8;;. (1) 


If the true values (or PEE means) of y; are denoted 
by Y,, then the true values of a; are 


A; = Iw, T(x 0) T. Cab. T$ (.;), 


( 
= B| Z wdy- Y) Tæ) [g wtu- 7969] / SS. 
- Z wi Tix) Thx ) varyi/ 8; Skr 
Because of the orthogonal property the numerator vanishes and 
cov (a,, a) = 0. (2a) 


The covariance of y, a; is given by 
cov (Yr G;) = E(y, — Y) Zw Y T,(z;)|S;;, 


or cov (yj, aj = T,(zx) vara; = T,(z,) ə?|S;;. (25) 
If z is any linear sum of the coefficients a;, 


it follows from (2a) that 


varz = XM vara, = X(A#/S;;) o*. (3b) 


For the power-series coefficients b;,, from (7.2.2,3), 


p p p 
var bp; = = Pin vara, = 2 Piel Six) o? = 之 87% Rot (4) 
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For the power-series coefficients c,; when the variable is changed 
from x to z, (7.4,4) gives 


D p p 
varo, = x vara, = D (Vk Skr) ° = ジッ yz の な の の. (5) 
k= j k=; kaj 


For the fitted value uw, (x), from (7.2.2,1), 
p p 
var ur) > T*(z)vara;= > [T}(x)/S;;] ol. (6) 
j=0 7=0 
The coefficients b,;, unlike the a,, are not statistically inde- 
pendent. If B,, Bi are the true values, the covariance of b,j, bpr 
is given by 
cov 5555 byk] = E[b,; si B 5% p" By] 
= EEP lta - 4] [Z8,, (a, 5 4 ,)]. 
and so 


p p 
cov [g, bpr] = PP sa Bx vara, = > (Bia Bral Sag) o. (Ta) 


The term in brackets is, from (7.3.4,3b), the element xi of the 
inverse matrix, and so 

cov 573. bpr] ニニ X;k 02, (76) 
while, from (4), var b = xj; 02. (7c) 


The variance of the fitted value us (e) can also be expressed in 
terms of the elements of the inverse matrix. For 


var|3 b; z] -E È (bp; — B,j) | b (by — d 
= Àj ECG By, (s Bux) 2°, 
q=0 Ü+k=q 
and, on using (75) and (7c), 
2p 
var fa (e) =S] X xa] as. (8) 
q=0 e = 


The elements of the inverse matrix in the sum lie along a line 
Parallel to the backward diagonal. 


8.1.1 Estimation of c from the residuals 
The residual v; is given by 


v; = y; Aa, (ch, 
j 


and, as E(v;) = O, 
E(v?) = varv; = vary; — 2 > cov (Yy; d,) T(x) + E T2(z;) var a/. 
j 
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On using (8. 1, 25), 
E(v2) = vary,— Y TY;) vara; 
j 
p 
= (ofwi) (i- Sr. Zeh / s,). (1) 
j= 
It follows that E Lu. uf -(n—p-—1)ce?, 
7 
and so 82 (to. vf) / (n — p — 1) (2) 


will provide an unbiased estimate of o?. 
The value Cor b can be obtained without calculating the indi- 
vidual residuals; as was shown in $ 7.2.5. 


8.1.2 Example 


In the column at the extreme right of the Doolittle scheme given in 
Table 7.2.3, the calculations of Xv? are performed using equation (7.2.5,3a). 
For the third-degree polynomial, Xv} is 0-037204, and so from (8.1.1,2) 


ss = 4(0-037204/63) = 0-02430 
is an estimate of g. The standard deviation of a, is then estimated as 
s[as] = ss。/JS。。 = 0-0176. 


The inverse matrix for this example is calculated at the bottom of 
Table 7.2.3. The diagonal elements give the standard deviations of the 
power-series coefficients. Thus 


S[bso] = ss Vo = 0-0435 
9[。:] = II = 00475 
selbes! = % Jxes = 00399 
s[bss] = ss Yss = 0-0176 


The standard deviations of the fitted values u, (x) are calculated for a 
number of selected values of z in Table 8.1.2, using (8.1,8). 

When the origin of x is changed to the value 一 2 (Table 7.4.1), the 
standard deviations of the new coefficients are found from the sums of the 
products yiz Qg; From Table 7.4.1, 


s[cao] = Dy. Quo = 8491-665 = 0-233, 
&[631] = S 4Eyır Qu. = 84190-77 = 0-336, 
SLI = SVD Ora = 8433-787 = 0-141, 
s[css] = s4Eyss Qus = 540-5228 = 0-0176. 


When the scale of the variable is changed, the standard deviations are 
multiplied by the same factors as the coefficients. The values derived in 
this section for s[a;], s[b,,], s[¢,;], have to be multiplied by the factors 
107 10 = 10?10-7 ($7.1.7) to give the standard deviations of the 
coefficients when the curve is expressed in terms of the original variable x. 
For the fitted values, j = 0 and the factor is 10" = 10?. For the standard 
deviation s, the factor is 107 V10* = 105. 
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8.1.3 Least-squares iheory im matriz notation 


The symbols listed in Table 8.1.3 will be used for the various 
matrices and vectors. As is customary, a row vector will be 
represented as the transpose of a column vector. The transpose 
of a vector or a matrix will be indicated by the superscript 7’. 


TABLE 8.1.3 
Matrix symbols 
Symbol Order Element 

x (p+1)x1 xi 
X (p+1)xn a 
b (p+1)x1 b;; 
B (p+ 1)x1 B., (the true value) 
y ** yi 
v nxi Vi 
$ "x1 ター Y, 
W nxn Wy = we Wy = 0 


8.1.3.1 Normal equations. In matrix notation, the residuals are 
given by the equation v= y—Xb. (1) 
The expression v7 Wv is a 1 x 1 matrix—that is, a scalar—and its 
value is Lw;v?. The least-squares principle calls for the minimiza- 
tion of Xw,v) = vT Wv = (yT - b" X) W(y—X7b). (2) 

If any scalar / is of the form 

y = bz = zTb = >z;byp 
7 


then — = 27 9 


and the differentials can be represented either as a, column 
vector z or a row vector zT. If (2) is multiplied out and differ- 
entiated, and the differentials written as column vectors, 


av? WV) / eb — 2XWy + 2X WX? b, 


and hence the normal equations are 


XWXT b = XWy. (3a) 
These are identical with the equations (7.1,3), since it is easily 
verified that = XWX7, M = XWy. (3b) 


X is not a square matrix, and, as division (i.e. multiplication by 
X-1) is only possible when the matrix is square, X cannot be 
divided out of (3a). 
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8.1.3.2 Standard deviation formulae. The coefficients b,, form 


the vector b = $-XWy, 
and the deviations of the 5,; from the true values B,; form the 
vector b—B = $-1XWS. 


Hence the square matrix (b — B) (b? — B7) is equal to 
b+ XW GST WT X7 9-17, 
The expectation of an element of this matrix is 
E(b,; — Bj) (bpr — Bpr) = COV (%, bx), 
and so the covariance matrix is 
E(b — B) (b? - B7) = $-! XW(E667) WT XT $17, (1) 
Now the (v, j) element of the product #(557 WT) is 
> Elyn ) (y; Tt) W. 
If the deviations 8 are uncorrelated E(y, —Y,)(y;—Y;) vanishes 
unless h = i, when it has the value / . Similarly, W is a 
diagonal matrix, and W;; vanishes unless i = j. Thus the product 


is just the diagonal matrix whose elements are c?. Hence the 
covariance matrix is 


中 一 XWZ(o21) xT o7 an c? p3[XWX7 cb], 
or, on using (S. I. 3. 1, 30), 
E(b — B) (b? — BT) = o? 7. (2a) 
Thus cov (b, Opr) = の (おう (2b) 


which is identical with (8. 1, 70) and (8.1,7c). 
The fitted value is 
(*) = bT x, 


and its variance is given by 
var u (e = xT E(b — B) (b? - BT) x, 
or var u (z) = xT b-1xo2, (3) 


This is the matrix form of (8.1,8). 


8.2 RESULTS BASED ON THE NORMAL LAW 


8.2.1 The distribution of s? 


When the deviations of the observations y from the values Y 
on the true curve follow à normal law, the probability of obtaining 
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a set in the ranges dy; about the values y; is 


dP(y) = olexp-> G. — Y*J2o1] I dy,. ① 


If the equation of the true curve on which the Y; lie is 
D 
Y = XA Z) (h, (2) 
j= 
then 
Z(y; —Y;)?/oF = ~ weve à: > 4; G [^ 


lI 


>u [y- Fa ms) + Z (ar- 4) Ted) [o 
2 
On using the orthogonal properties of the polynomials and the 
. Zw, fy, Ta, T,(z;)) (と /) = 0, 
it follows that 
X(y,—Y;[o? = Xw,vilo?-- X (a; A,) Ew; TN,. (3) 
j 


A change of scale 


y? = yilo; = wi yilo (4a) 
transforms (/ - F.)? / o according to the equation 
Z(y, Te) = Z(y? — Y?) (46) 


The expression on the right corresponds to the separation in an 
n-dimensional space of the point whose coordinates are y? from 
the point whose coordinates are Y}. If these coordinates are now 
changed by the transformation 

z; = > {u} T(x) [Zw THx,)}*} 9? = [Ew T7(x,)}* a/o, 

t 

j = to p, 25,1. „ Z4 1 Orthogonal to each other and (5a) 

to the z;, 


this separation will be preserved provided the transformation is 
an orthogonal one, corresponding to a simple rotation of the 
axes. But, from the properties of the polynomials 7;(z), 


= w} T,(z;) wt T;(x;)/{Zw; T3(x,)}* (Zw, Tèl) ) = 85), 
and so from $ 2.5.1 the new coordinate axes are at right angles. 
ame E(y, - Y)*]oi = Ee, — Ach. (5b) 
The distance of the point Y? from the origin is 
Zi XY? = Lo, F/ os, 


256 POLYNOMIALS AND OTHER CURVES 
or, on substituting for Y, from (2), 
D 22 N x;) / o. 


1-0 


But, from (5a), 
X Aw, 270 / = Èz (5c) 
and so Zi, , Zi vanish and 
Z-Y} = È e, Z4 2, 
or, on substituting for z, from (5a), 
Z-Y) lo} = È (aj— Ai) vu. fol B. Š (0) 


Hence the probability distribution (1) transforms into 


dP(a, 4) = Cexp|- tÈ (a, — Aj? Zu, THe let} Nas, 


x exp [- PE IIdz,. (7a) 


Comparison of (3) and (6) shows that 


n-1 ^-—1 
Di Du vf /s. (75) 
p+l ¿=0 


Therefore the a; are normally distributed about the A; with vari- 
ance o?/Xw; T?(x;), Luo: vt /o? is distributed as x? with v = » —5—1 
d.f., and the distributions of the a; and of Nuo, v are all inde- 
pendent of one another. 
The quantity 

= Lw,v?/(n—p—1) (8a) 
will then provide an unbiased estimate of os, and vs?/c? is distri- 
buted as x? with v = n—p—1d.f. Hence, as in 8 2.5.3, 


vars? = of/4(n—p—1), vars = o?/2(n—p—1). (8b) 


The x? tables can be used to test the significance of the difference 
between an observed value s and an expected value c. 


8.2.2 Tests of significance 
The theorem proved in § 3.1.4 shows that the ratio 
- a;— A; _ (a; — A;) (Si, 
$(a;) 5 


(la) 
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is distributed as ¢ with v 22—p-—1d.f. This ratio can be used 
to test the significance of the departure from an assumed true 
value. Im particular, the ratio 


£ = O51 „S511. 5108 (15) 


can be used to test whether the coefficient % is significantly 
different from zero, and hence to provide a guide in the choice 
of the degree of the polynomial if this is not already known. 
Similarly, the significance of the difference between two separate 
determinations a; and aj can be tested by the ratio 


a; —a; — (A; — A7) 


F (@gー 45 (2a) 

where the standard deviation of the difference is given by 
oB = 8°(a;) + H = (S Siz") 85, (26) 
with = (Lw; v; + Dw; v2) /n +n” — 2p 2). (2c) 


The — coefficients b, and the fitted values z; (z) are 
linear functions of the a;, and so t-tests can be used for these 
quantities also. Thus for two different estimates of the same 
curve 

t = (u,(z) - u5(2))/s, to? [uw (2)]/o? + our, (2)]/0*)* (3) 
will test the significance of the difference between the two fitted 
values. 

If the two curves are obtained by different experimental 
methods, so that the estimated quantities may have different 
standard deviations the ratio of which is unknown, the quantities 


a;—a; —(A;— A7) wu, (x) — u> (z) 
(52(a;) --52(a7))* ^ — (s?[u; (2)] - ?[u7 (z)])* 
should be used to test 1 significance of the differences, either 
by Behrens' test ($ 3.5.3) or Welch's test ($ 3.5). 
8.2.2.1 F-test for 84 pes ee of the polynomial. If the degree of 
the polynomial is not known, it is customary to examine the 
sums of the squares of the residuals calculated from 


(4) 


k 
Xs = > の 一 と の A,. (1) 


If the curve is really of degree p, the sum should decrease rapidly 
as k increases until the value p is reached, after which the decrease 
should be very slow. 


18 
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If the degree of the curve is in fact p, A,,, is zero and a,,, is 
distributed normally about zero with variance o?/S,,,, ,,,. Hence 
j " J - 
Lab. "T d ーー È apra Mp +g/ T (2a) 
q= 


fad p+q "p 
q=1 


is distributed as x? with 7 d.f., while 


Dw; v5 %% = (n—p—j — 1) s}? (2b) 


is distributed as x? with n—p—j—1 d.f. Hence, on the hypo- 
thesis that all the 4,,,, are zero, the ratio 


š 224 p+q > wi i の +J, i 
F = 


n—p -j-1 


e 1 un fn- — =j= 1) (3) 
2; v» Lj, £ J t j J 

is distributed as F with (J, —9p —j— 1) d.f. The significance of a 
whole series of coefficients can thus be tested simultaneously. 


More commonly, the significance of a,,,, alone would be tested. 
Since アー だ when v, = 1 ($3.1.3), the test reduces to the t-test 


discussed in $ 8.2.2. 


8.2.2.2 Example 
For the example of Table 7.2.3 
a, = —0-0744, s, = 0-0243, /s = 1-383. 
Hence the value £ given by (8.2.2,1b) is 
t = — 0-0744 x 1-383/0-0243 = — 4-23 (63 d. f.), 


which is well below the 0-1% level. It would then be expected that the third- 
degree coefficient would be significant. 

It would therefore seem desirable to extend the calculations to obtain 
the fourth-degree coefficient a,. When this is done, it is found that 


Su, = 2:2941, a, = 0-002619, s, = 0-0244. 
Then t = 0-002619 x 1-515/0-0244 = 0-16 (62 d.f.), 


and this coefficient is certainly negligible. 

If the Doolittle scheme has been carried through to the fourth degree, it 
is possible to test whether a second-degree polynomial would suffice by 
using (8.2.2.1,3). Thus 


Zap, v3; = 004780, Law; v3, = 0-037189, 


0-04780 62 
0-03719 一 1) T = 9:95 


amd PF =| 2 


while the 0-1% level is 7-8. 
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8.2.2.3 Analysis of variance table. Statisticians often rewrite 
the last column of Table 7.2.3 in the form of an analysis of 
variance table. A typical scheme is shown in Table 8.2.2 
(Goulden, 1952). 

The entry in the variance column is the sum of squares divided 


by the degrees of freedom, and the F value is the ratio of the two 


As F is by definition always greater than unity, the ratio for 
p = 4is error variance divided by regression variance. 


TABLE 8.2.2 
Analysis of variance table for Example 7.2.3 


Degree of Sumsof Degrees of 5% 
fitting squares freedom Variance F Point 

Total (Ey?) 1-218016 67 

0 Regression (Mo ag) 0-952837 1 0-952837 
Error (Xv) 0-265179 66 0.004018 237 

1 Regression (4 ai) 0-119525 1 0-119525 
Error (Xv?) 0-145654 65 0-002241 53 

2 Regression (Ksa) 0-097853 1 0-097853 
Error (=v) 0-047801 64 0-000747 131 

3 Regression (4 a) 0-010597 1 0-010597 
Error(=v3) 0-037204 63 0-000591 18 

4 Regression (.Z,a,) 0-000016 1 0-000016 
Error (v3) 0-037188 62 0-000600 38 252 


8.2.3 Test for homogeneity 

Suppose that r separate sets of observations have been taken, 
giving rise to + sets of coefficients 0% ,. If the true values B,; , 
are all the same, and c is the same for each set, the 5% % will be 
distributed normally with variance 


02(5% a) = , (1) 


where /e is a known function of z; , and W; The weighted 


J. 4 


mean of the estimates 55 is 


b; = ~ W, bug. dX W, の (2) 
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As regards the residuals from the mean 6,,, the sum 


E W, (by, a bg) ef (3) 
q 
will be distributed as x? with r— 1 d.f. Also 
22 È Wi, SUL alo? (4) 
q 


will be distributed as y? with n—r(p + 1) d.f., where n is the total 
number of observations. Hence the ratio 


P ニュ ZW, (bp; bre EXw, Ula 
FE (8) 


will be distributed as F with (r—1,n—rp-—r) d.f., if the values 
bpj, a are homogeneous and c is the same for each set. 

It will be clear that, since the forms of the orthogonal poly- 
nomials depend on the values z, % and W; the coefficients a; , 
would not be expected to be homogeneous unless the values x; 
and w; were the same for all sets. 

An example on the testing for homogeneity of the slopes of 
straight lines is given in $ 6.2.4.1. 


8.8 MINIMUM VARIANCE ESTIMATES 


In this section it will be shown that the unbiased estimate 5, 
whose variance has the smallest possible value is identical with 
the least-squares estimate. This result is often referred to as the 
Markoff theorem, although it was originally proved by Gauss. 


If the quantity bpr = > 271 Yi (1) 


is to be an unbiased estimate of B, then 


E(b,,) = Le, E(y;) - > Z, > Bpk ak 


must equal B, and so 


= Xu gp. (2) 
The variance of the estimate (1) is 
var bpr = 222, var Yis 
and so, for small variations Az,;, 
A(varb,,|[2o?) = X(z,w;) ^z,;. (3) 


The variance will be à minimum when this expression vanishes. 
However, the variations Az,, cannot be independent, since, 
from (2), 


Exi A2, = O (p+1 equations). (4) 
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It would be possible to eliminate カエ 1 of the variations Az, 
from (3) by solving the set (4) for these variations, and then to 
obtain the minimum variance conditions by equating the co- 
efficients of the remaining n—p— 1 variations in (3) to zero. 
However, this would produce an awkward unsymmetrical set of 
equations, and it is better to introduce ヵ 十 1 independent 
(‘Lagrangian’) multipliers A,;. Thus if each of the equations (4) 
is multiplied by M, and subtracted from (3), the minimum vari- 
ance conditions are 

» m 5) 一 š À i Az, = 0 (5) 

Z< | ri "d — i "vri ° 

il j=0 J 
Now n—p-—1 of the Az,, can be chosen arbitrarily, so that their 
coefficients must vanish. Further, the remaining p + 1 coefficients 
can be made to vanish by suitable choice of the p + 1 multipliers 


À, j. Hence the symmetrical set of conditions 
p 
Z = PU 20 (6) 


is obtained. 
The multipliers A,; are determined by the substitution of (6) in 
the conditions (2) for the estimates to be unbiased. 'This gives 


Dn 
+ +k 一 
LN D via = 6 
i 


j-o 
Dn 
or E A Pjr = Sr (7) 
j=0 
where Gir = Trio 


as in the least-squares theory. Hence M, is the element y,; of the 
inverse matrix chi, and so from (1) the minimum variance esti- 
mate is 


p p 
bp = X xo D wy - È xej My, (8) 
j- 


j=0 
which is identical with the least-squares estimate. 


P 


8.3.1 The normal equations for correlated variables 
When the deviations of the observations are correlated, so that 


E(y,; — Y;) (yy Vr) = Pin 9192 = Tins 
E(y;—Y;?-—obi-o;, 


も 


(1) 


the values c;, defined by (1) form an n xn matrix ø. The inverse 
of e will be noted by W. A natural extension of the least-squares 
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principle, which for uncorrelated observations states that Zw, v? 
is to be minimized, is that in the present case the quantity 


vr Wv (2) 
should be minimized. Then, as in $8.1.3.1, the normal equations 
are db = M, (3a) 
where ch = XMWXT (35) 
and M = XWy. (3c) 
The elements of (3b) and (3c) are 

Prs = IN (3d) 
and M. = > > Win Yr (3e) 


These quantities are considerably more complicated than the 
corresponding quantities for the uncorrelated case. 

As in the uncorrelated case, it can be shown that the estimates 
b,; given by the least-squares principle are identical with the 
minimum variance estimates. This will be established in the 
next section. 


8.3.2 The generalized Gauss-Markoff theorem in matrix notation 

The elements z,, in (8.3,1) form a (TI) n matrix Z, such 
that b = Zy. (1) 
If b is to be an unbiased estimate of B, 

E(b) = ZE(y) = ZX7B, 
and so ZXT = I. (2) 
The covariance matrix for the Doj is 
E(b — B) (b? — B7) = ZE(y - Y) (y^ —Y7) ZT = ZeZ7, (3) 


where c is the matrix defined in (8.3.1,1). 
The variances are the diagonal elements 


DD Art Cih Zens 
i ん 


and so the condition for minimum variance of b;, is 
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for arbitrary small variations A2. Hence the minimum variance 
conditions are 


> (Zo Az, = 0 (4a) 
with the conditions > (Xy Ar, = 0 (4b) 
t 


imposed by the requirement (2) for unbiased estimates. 
A Lagrangian multiplier matrix A, of order (p + 1) x (p+ 1), is 
used to combine the conditions (4a) and (45) into a single equation 


Y (Zo —AX),; Az,, = O, 


ri 


and, as the variations Az,, can now be considered independent, 


Zo = AX. (5) 
Hence, on using (2), AXc-1XT = J, 
or A = (XWXT)-! = $-1, (6) 
where W = o~! is the weight matrix. Thus 
b = Zy = AXWy = $-7!M, (7) 


where 中 and M are identical with the corresponding quantities 
derived by the generalized least-squares method of § 8.3.1. The 
Gauss—Markoff theorem on the equality of the least-squares and 
minimum variance estimates is therefore established. 

When the deviations y; — Y; are independent, e is the diagonal 
matrix whose elements are o? and W the diagonal matrix whose 
elements are w; = l/o}. The quantities % and M, then have the 
simpler forms (7.1,2). 


84 TABLES OF STANDARD DEVIATIONS 
FOR THE EQUALLY-SPACED CASE 


Formulae and tables giving the standard deviations of the fitted 
values have been prepared for the case when the observations are 
equally-spaced and of unit weight. The standard deviation is, 
from (8.1,6), 


p i * 
«tu (€) = | STH/ETH«,)}] o (1) 
On changing the variable to 
> = 2e[n = 2(x —Z)/nAz, (2) 
the standard deviation can be put in the form 
o[u,(k)] = n™ ppolk, n) o, (3) 


where p。o( た ,%) is a function of k and n which can be evaluated 
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by means of the standard expressions for T;(e) and ZT?(e;). It is 
found that po, n) only varies slowly with n. 

The range of the variable e may be divided into two parts: 
the region of interpolation, comprising the values |e| < łn, i.e. 
| た |<1: and the region of extrapolation, comprising the values 
|e| > 3⁄2, i.e. | を | > 1. 

In the region of interpolation the variation in Ho, n) is com- 
paratively small. Table 8.8a gives the values p。o( た ,%) for | k|« 1 
and for various selected values of ». Intermediate values may be 
obtained by linear interpolation between the tabulated values. 
The error arising from interpolation is generally less than 1 per 
cent, and never exceeds 2 per cent. 

In the region of extrapolation p,o(k,n) may be split up into 
two parts, 


pzo( ん n) 3 pzo( ん ) $, (n), (4a) 
where Ppolk) = Ppo(ks o (45) 
and (2,(n))? = (1— n~?) (1 一 4n-?) . . (1 — ?n-?). (4c) 


These functions are listed in Table 8.85. The error introduced by 
splitting p, (k,n) into two factors is less than 1 per cent for » 
greater than 12. When n is less than 12, the error is somewhat 
greater for values of k near 1; it is always less than 5 per cent, 
except in the single case » = 7,p = 5. 

Table 8.8b extends to k — 3. Beyond this value the function 
Pyo(k) can be written to a reasonable approximation as «o, , 
where o, is à constant. 


8.4.1 Variation of the standard deviation with the location of the point 


Examination of Table 8.84 shows that, for values of |k| 
less than 0-9, (, M) differs from p; (k)= p, oo) by at most 
2 per cent for » greater than 18, and by at most 1 per cent for 
n greater than 25. Hence for reasonable values of n the curves 
giving the variation in standard deviation are practically identical 
with the curves for n = co. 

The- curves of p; (k) in the region of interpolation are drawn in 
Figs. 8.4.la and 8.4. 15. The curves have p minima and p—1 
maxima, all symmetrically located about « = 0. The maxima and 
minima are shallow, and the general trend is for the standard 
deviation to increase slowly as |e| increases; that is, successive 
maxima and minima are somewhat higher than the preceding 
ones. Beyond the last minimum the standard deviation increases 
quite rapidly. There is a transition region between the region of 
interpolation and the region of extrapolation. 
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-0.8 —-0-66-0.4—0:2 0 02 04 06 08 k 


Fig. 8.4.1a. Variation of standard deviation in the region of interpolation— 
p even. 


—0-8—0-6—0-4—0.:2 0 02 04 06 08 た 


Fig. 8.4.15. Variation of standard deviation in the region of interpolation— 
p odd. 


-2 -15 -1-05 0 05 1 15 2 た 


Fig. 8.4.1c. Variation of standard deviation in the region of extrapolation. 
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The curves of p; (E) in the region of extrapolation are drawn 
in Fig. 8.4.1c. It will be observed that the increase is very rapid 
beyond | た | = 1, especially for the higher values of p. Considerable 
caution should be exercised in extrapolating polynomials, especi- 
ally if the degree is not definitely known. 


8.4.2 The use of the tables 


In à practical problem, o is usually unknown, and an estimated 
value s has to be used in (8.4,3). The procedure for finding the 
estimated standard deviation s[w,(«)] of the fitted value at the 
point e may be summarized as follows: 

(i) Evaluate | ん | = 2|e|/n to three decimal places. 

(ii) (a) If |k|< 1, determine the value of %%, u“) by inter- 
polating between the listed values of k in Table 8.8a, using the 
listed value n’ closest to n. Estimate p, ) by examining the 
variation with n at this point in the table. 

(b) If | 5|» 1, determine p,.(k) by interpolation in Table 
8.8b, and $,(n) from the lower section of this table. 


(iii) (a) If | | « 1, s[u,(«)] = pp, n) s/n. (1 
(b) I£ | k| » 1, .[w%,(e)] = p, (k)$;,(n)s|Jm. (2) 


8.4.2.1 Example 


The calculation of the standard deviations of the fitted values at the points 
of observation by formula (8.4.2,1) is shown in Table 8.4.2 for the fourth- 
degree polynomial of Tables 7.6.2.2, 7.6.2.2a, and 7.6.2.3b. In this example 
n is 25 and s, 0-0328. 

The standard deviations at points beyond the range of the observations 
are calculated by formula (8.4.2,2) in the lower portion of Table 8.4.2. 


8.4.8 Rough approximations to the standard. deviations 

In many cases only a rough approximation to the standard 
deviation of the fitted value is required. Table 8.4.3 gives expres- 
sions for the standard deviation which are accurate to within 
20 per cent over the ranges of e and n shown. 

In Example 8.4.2.1, s, = 0-0328 and n = 25, and so the rough 
value of s[w,(e)] is 0-013. This is close to the accurate values 
calculated in Table 8.4.2 when |e| is less than 10. 


8.4.4 Variance of the residuals 
From (8.1.1,1), 
var vr = of var uc), (1) 


and so in the equally-spaced case 


varv; = O- , )]. (2) 
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It is apparent that the variance of the residuals at the extremes 
of the range is a little less than at the centre of the range, although 
the difference is small if » is large. This is equivalent to the 
statement that the curve ‘fits’ the extreme observations some- 
what better than it does the central observations. 


TABLE 8.4.2 
Standard deviations of fitted values (Example 8.4.2.1) 
sa = 0-0338 m = 25 


(a) Region of interpolation 
S %u = 0-00656 


le! |k| = 2|ei/n Pso( た 。 25) s[u,(e)] 
0 0 1-88 0-0123 
1 0-08 1-86 0-0122 
2 0-16 1-80 0-0118 
3 0-24 1-75 0-0115 
4 0-32 1-75 0-0115 
5 0-40 1-82 0-0119 
6 0-48 1-95 0-0128 
7 0-56 2-08 0-0136 
8 0-64 2-15 0-0141 
9 0-72 2-12 0-0139 

10 0-80 2-12 0-0139 

11 0-88 2-60 0-0171 

12 0-96 4-02 0-026 

(b) Region of extrapolation 

$,(25) = 1-02 das(25) %% /n = 0-00669 
le] LI Pao(À) Lu) 

14 1:12 9-83 0-066 

16 1-28 20-6 0-138 

18 1:44 37-6 0:25 

20 1-60 62-4 0-42 

22 1-76 97 0-65 

TABLE 8.4.3 
Rough approximations to 8[?4。(e)] 
Degree p s[u,(e)] Range of |e | Range of n 
1 1-28 0 — 0-32n coto 7 
2 1:5s,/ In. 0 — 0-38n coto 7 
3 1-88,//n 0— 0-41n coto 7 
4 2-0s,/ n. 0 — 0-42n coto 7 
5 2-25. In 0 — 0-44n co to 10 
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The residuals v, and the fitted values u, are statistically inde- 
pendent. For from (8.1,25), 


COV (Yrs ) = > T,(z;) cov (Yn: a,) = > T,(z,) T;(2;) ,, 
while 
COV (Un, u.) zT) Tj. (x;) cov (a5, a.) = E Dr,) T;(x;) o2|S;;. 
Hence 
COV (Yp Uz) = cov (Up, Ug) = E D,) T,(z;) o2/S;; (3a) 
and COV (Vp, Uz) = cov (yj — u, Ug) = 0. (35) 


8.4.5 The polynomial coefficients 

The standard deviations of the polynomial coefficients may also 
be calculated from tabulated functions %%, n). If the curve is 
expressed in the form 


U,(z) = Dez (la) 
with z = e—7g, (15) 
then from (8.1,5), 
の š 
0) = [E85 o. (1c) 
一 了 


Since y;x is a known function of 8% and g, (le) can be written as 
a function of n and g in the form 


c[c5;(k)] w pp; (k, n) c [ni**, (2a) 
where k = 2g/n. (2b) 


The values p,;(k,n) have been tabulated by Guest (1950c) for 
polynomials up to the fifth degree. Since these tables will only 
be required occasionally, they will not be reproduced here. 


TABLE 8.4.5 


Standard deviations of power-series coefficients (Example 8.4.5.1) 


s, = 0.0328 n= 25 |k| = 0-96 


j P43(0-96,25) nirk (o, 

0 4-02 5 2-64 x 10-2 
1 60-5 125 1-59 x 10-2 
2 263 3125 2-76 x 10-? 
3 416 781 x 10? 1-75 x 10-4 
4 215 1953 x 105 3-61 x 10-§ 
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8.4.5.1 Example 
For the fourth-degree polynomial of Table 7.6.2.2 n is 25, and so if the 
origin is chosen at e = —12, | | = 24/25 = 0-96. From the tables (Guest 
1950c), the values p,; (k.n) are as listed in Table 8.4.5. The estimated 
standard deviations of the coefficients are then given by 
8(C4;) = pu (0-96,25) s,/n?*1. 


These values are listed in the last column of the table. 


8.5 STANDARD DEVIATIONS IN THE 
UNEQUALLY-SPACED CASE 


In the present section formulae will be obtained which will give, 
at least approximately, the standard deviations of the polynomial 
coefficients and fitted values when the observations are unequally- 
spaced. The procedure adopted is to characterize any particular 
set of observations by two parameters, denoted by x, and xc。. 
The parameter x, is a measure of the departure of the independent 
variable x from symmetry about the central value, while the para- 
meter ks is a measure of the relative concentration of the observa- 
tions towards the central values of x as opposed to the extreme 
values. Tables of the standard deviations in terms of these 
parameters will be given. 

Although the tables were calculated principally for use in 
theoretical discussions, they may also be of use in practical 
examples, either for the rough calculation of the standard devia- 
tions or for the checking of the values obtained by the more 
usual methods. 

Unfortunately, the treatment in terms of the parameters x, 
and x3 is not adequate for all possible sets of data. In certain 
cases it would be desirable to take into account higher-order para- 
meters x, and «y. However, it is found that the treatment given 
here is adequate for practically all cases in which the curve is of 
the first or second degree, and for a large proportion of the cases 
in which the curve is of the third degree. 


8.5.1 The smoothing of the points of observation 

When the values of the independent variable z; at the n points 
of observation are arranged in order of magnitude, each observa- 
tion may be identified by a number e; giving its position in the 
sequence, <, taking the integral or half-integral values from 
—i(n—1)to +4(m—1). In the present discussion the system of 
points x; will be replaced by a smoothed-out system X, obtained 
by fitting a curve of the third degree in e to the values z;. The 
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smoothed-out system of points is given by the equation 


X, = k th, THe) + ks T$(e;) + ka T$(e;), (la) 
2 
visis k; = X Tile) te / KG) (1b) 
4 £ 


and Ty(e) is the orthogonal polynomial of degree j in < for the 
equally-spaced case, whose properties have been discussed in $ 7.7. 
The superscript e is added to distinguish the polynomial from the 
orthogonal polynomials in the variables x or X. 

By a change of origin the term k, can be made to vanish, and 
X, can then be written in the form 

X, = $7! [e Tf(e;) +n xs T$(e;) + 2n7? <, T$(e;)], (2a) 

where Kı = jk, ks = nl, kx, = In? Pky. (2b) 
The values kj are usually of the same order of magnitude. The 
scale factor $ will be chosen so that the range of the values $X, 
is approximately equal to (n — 1), as in the equally-spaced case. 
It is found that the form for $ which is the most convenient in 
the arithmetical manipulations is 


$ = [k - Yg(n* + 1) ky]. (3) 
Then phy TY ( + 1) de, = 1 = xy +$(1 +n?) ks, 
or 41 = I- n kg. (4) 


The original set of points z, is thus replaced by a smoothed- out 
set characterized by the three parameters é, xə and ra， 
The range of $X is, by use of the standard formulae for 2(<), 
(n — 1) + 2 k [(n — 1)8/4 — (3n? — 7)/20) (n — 1)] 
= (u- I) ei 1(1— 5n-! 6 20 ky), 
and, on substituting for <, from (4), 
Ra[$ X] = (n — 1) - (1 n7!) kg. (5) 


8.5.2 The parameters ks and «s 
Values of k,, z, and k, could, if necessary, be found by the 
conventional least-squares procedure for equally-spaced data, 
x being treated as the dependent variable and < as the inde- 
pendent variable. However, very often rough approximations will 
suffice. If X., X., Xo X ,, X; denote the values of X for which 
e takes the values --1(n—1), --1(n—1), 0, —à(n—1), —i(n— 1), 
then, from (8.5.1,1a), and the standard expressions for the ortho- 

gonal polynomials, 

X44 Xa 2X, = 3k (n — 1), (1a) 
X- X 4,—2(X,, — X 4) = ñk,(n— 1), (15) 


to 
-I 
— 
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and, from (8.5.1,5), 
X47 X4 = ($7 - 10 — 1) k} (n - 1). (1c) 


Hence, if &, etc., denote the observed values corresponding to 
the same five values of e, the values of the parameters can be 
estimated from the formulae 


2(z,, TEa 一 22) 


た 。 = (n— 1 (2a) 

. _ 16f(z 4, —z_,) 2(x,4 — o f) 
"e 3(n — 1)? ! (25) 
$3 = 9H e- s, (3a) 
ce = "dk. xy = An. (35) 


Approximations which can be calculated even more rapidly are 
obtained by using the value n for » — 1, and neglecting the second 
term in (3a) in calculating x, and &. Then 


MEORUM (4a) 
2 *. 3 —Ma i 
p = Š Ge T 2) 7 304 724) (4b) 
3 3 . 1 = I 
a 1 
and の = ccnl Jii € 


vu Z 


The significance of the parameters x, and <, can be brought 
out by rewriting (4a) and (45) in the forms 


( -% / — 2-4) = (2 . (5a) 
(244 —24)/ (x44 72-4) = (8—3«,)/16. (5b) 


Thus x, is a measure of the departure from symmetry about the 
central value zo (e = 0). cs is a measure of the relative concentra- 
tion of the observations towards the centre of the range. For the 
equally-spaced case, c = 0 . When x, is +1, the first half 
of the observations (for which e is positive) is spread over three- 
quarters of the range of x. When ks is -- 4/3, the central half of 
the observations (for which ée is less than 1(2—1)) is confined 
to à quarter of the range of z. 


8.5.2.1 Example 

To find the values of x, and x, for the 67 observations listed in Table 7.1.1, 
the values of z are required for the observations numbered 1, 173, 34, 501. 
and 67. These numbers are 1--j(n— 1)/4. The value of z corresponding to 
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174 is taken as the mean of the values for 17 and 18. Then 
244 29-6, 244 11:0, zy l'l, 
2-3 — 15-2, z-, — 6-5. 
The values obtained from (8.5.2,4) are 
Ka = 2(29:6—15-2—2 x 1:1)/(29-6 + 15-2) = -- 0-54, 
kg = 2-67(29:6 + 15-2—2 x 11.0 一 2 x 6-5)/(29-6 + 15:2) = + 0-58, 
é = (67 —1— 0-58)/(29-6 + 15-2) = 1-460. 


8.5.2.2 Range of the parameters x, and x4. There does not 
appear to be any very simple criterion which fixes the ranges of 
the values x, and x, likely to be encountered in practical examples. 
However, it seems that neither parameter commonly exceeds 1 in 
magnitude, and so tables will only be given for values between 
十 1 and —1. If |x| and |<,| are much greater than 1, it is not 
likely that the approximation (8.5. I, 20) would be an adequate 
representation of the points z;. 


8.5.8 The orthogonal polynomials T,( X) 
The orthogonal polynomials J, X) are written in the form 


j 
TAX) = È by X* (la) 
j—1 
or T(X) = X!— Y oy Ty(X), (15) 
k=0 
, j-i ! 
with 2 dec > Pin Om (1c) 
and eg = 2) Xi TAX) / T THX). (1d) 


These polynomials can be calculated in turn from the polynomials 
of lower degree. 

General formulae can be derived by using the known expres- 
sions for T*(e;) and E(T*(e;)). It is found that n occurs in these 
expressions as powers of »-?. For, from Table 7.10g, 


E(T$(e)? = (/ R.) (IT m7? tsn...) 


and Bis = (mI) (1 +q n? . ). 
If powers of n-? above the first are neglected 
ET*?(X,) = $7? (n**1/ R,)f,(1 — n7*g,), (2a) 


and eg = (nY 0,,(1 — n7? cops), (2b) 
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where f;, g;, Orj and wy; are functions of x, and «s. These func- 
tions are too complicated to be written out explicitly, but they 
have been calculated for selected values of <, and x,. f; and g; 
are tabulated in Table 8.8c. R; is the numerical factor occurring 
in the expression for ={7'¢(e;)}*, and it is tabulated in Table 7.10a. 
The first three values are R, = 12, R, = 180, R, = 2800. 


8.5.4 Standard deviations of the orthogonal coefficients 

The standard deviation of the coefficient a; is given by the 
equation š ar 

q vara; = o?[a;] = o?/XTF(x,). 
If the approximation =7'7(X;) is used for =7'}(x;), then 
vara; = $7 g*(R;[n*/*Y)/fi(1—m-73g;). (1) 
The term »-?g; can usually be neglected. Since 
L{T Ge) P = n9 IR; 


方 gives the ratio of the variance in the equally-spaced case to the 
variance in the general case for the same value of 4. 

It will be seen from Table 8.8c that, for all three values of 7, 
negative values of «4 yield values for f; greater than unity and 
positive values of «4 yield values for f; less than unity. That is, 
the standard deviations are reduced if the observations are 
crowded towards the extremes of the range and increased if the 
observations are crowded towards the centre of the range. 


8.5.5 Standard deviations of the fitted values 
The standard deviation of the fitted value at the point z is 
given by 


varu,(z) = olan (ef = e* $ [76 | S. 
j=0 7 
If the smoothed values X, are used in place of the observed 


values x; this becomes 
p 


etu ()en Sg, XTR 
or o[u,(z)]/o2 = n- E (DB, (n$3)* (X$) Rif; (1) 
120 


The coefficients B, can be evaluated from the expressions for ak; 
given in (8.5. 3, 26). 

The first-degree polynomial has been discussed in $ 6.3.1. For 
the second- and third-degree polynomials the curves are found to 


19 


トウ 
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be roughly symmetrical about the value of z given by 


Xin = . 
Hence for purposes of tabulation the variable 
k = (24/n) (z — Z) — [5 (2) 
is convenient. Then 
ol (a) = n7 ppolk, Ka xa) o. (3) 


The functions pa(k) and p, (k) are analogous to the corresponding 
functions pol) in the equally-spaced case. They are given in 
Table 8.84 for the range k—1-4(0-2)+1-4, 45— 1-0(0-5) + 1-0, 
Kk — 1-0(0-25) + 1-0. 

When |x| is large the values of pə and ps, near | た | = 0-5 are 
increased for points with kx, positive and decreased for points 
with kx, negative. The parameter x, has a much less marked 
effect. In general, the values of p。。 and pgg are increased when x, 
is positive and decreased when x, is negative. 


8.5.6 Estimation of standard deviations of fitted values from the 
tables in practical examples 

The steps in the estimation of s[u,(x)] from the tables when 
the polynomial is of the second or third degree may be sum- 
marized as follows: 

(i) The observations are supposed numbered in decreasing order 
of z from 1 to n. Write down the values £p, Lip Zos z 4, Z} of 
the variable z, for the observations numbered 1, 1--i(»— 1), 
1 - £(n — 1), 1 2- £(» — 1), n, interpolating where necessary. 

(ii) Calculate 


Kg = 2(% y T. 2z9)/ (Y. — 2 .,), 
ks = 2-97 ( -. 2 72 4)]/ (5.4 — 24); 


$ = (n—1-—x3)/(z.4 23) 


(iii) Calculate 
2 9 1 
TECER 
n nn 5 


for each value z at which the standard deviation is required. 

(iv) Find p (k, ks, cg) by interpolation in Table S. Sd using the 
values xs, xs nearest to x, and «g. 

(v) Then 


s[u,(z)]= pk, s, K3) sp/ 


where s, is an estimate of o. 


bo 
- 
Ct 
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8.5.6.1 Example 
The values 
Ke 一 十 0.54， ks = +058, の = 1-460, 
were derived in § 8.5.2.1 for the observations listed in Table 7.1.1. Now 


2ó/n = 0-0436 and Erx;/n = 3-01, and so 


2 9d Ym. ke 
k= Ax 2 一 = = L =s) = 00436 — 0-239. 
n n n 5; 


The values た for various values of v are calculated in Table 8.5.6. The values 
Pso・ pao are entered from Table 8.8d, taking x, = 0-5, x4 = 0:5. 

For the second-degree polynomial the values ps are to be multiplied by 
S/ n. From Table 7.1.8, s, is 0-0273 x 107 /10*, or 27-3. For the third- 
degree polynomial the values oso are multiplied by s/n, where s, is 24-3. 

In each case the values of standard deviations calculated from the 
inverse matrix (cf. Table 8.1.2) are shown for comparison. 'The difference 
between the approximate value and the accurately calculated value is 
small except near the ends of the range. The method of the present section 
is much quicker than that of Table 8.1.2, and it does not require the values 
Xir of the elements of the inverse matrix. 


TABLE 8.5.6 
Estimation of standard deviations of fitted values from the tables 


84 24-3, 8% n 2-97; 5 27.3, % m 3-34. 
k = 0-0436x — 0-239 


3rd degree 2nd degree 
polynomial polynomial 
Using Using 
inverse inverse 
s[u3] matrix | pso s[us] matrix 
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8.5.7 Variation of standard deviations with range and number of 
observations 
The standard deviation of the coefficient q, is from (8.5.4,1) 
approximately equal to 


$ (Rf; omit, (1) 
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while from (8.5.1,5), 


$= (n — 1)/(Rax). (2) 
Hence, as が is close to unity, 
ol. ^ o 4.R;| (Ra x) In. (3) 


The standard deviation of a; is then inversely proportional to the 
jth power of the range and to the square root of the number of 
observations. 

The standard deviation of the fitted value in the region of 
interpolation is, from (8.5.5,3) and Table 8.8d, of the order of 
2e||n for the second- and third-degree polynomials, and so is 
inversely proportional to the square root of the number of obser- 
vations. In the region of extrapolation the coefficient of highest 
degree b,, =a, becomes dominant and the standard deviation 
varies as this coefficient. 

In general, the coefficient b,, varies approximately as a; when 
the origin is in the region of interpolation and as a, when the 
origin is in the region of extrapolation. The transition region 
between these two regions may start at fairly low values of *, 
and in fact b, , , varies as a, even when | ん | is quite small. For 
high values of j even a small increase in the range of the observa- 
tions leads to a considerable reduction in the standard deviations. 


8.6 OPTIMUM SPACING OF OBSERVATIONS 


When the degree of the polynomial is not known with certainty, 
or when it is desired to check whether the observations can in 
fact be adequately fitted by a polynomial of given degree, it is 
probably best to space the observations more or less uniformly 
throughout the range. If, however, the degree of the polynomial 
is known, other spacing may be preferable. de la Garza (1954) 
has discussed how the spacing may be chosen so that the maximum 
variance of the fitted value in the region of interpolation is as 
small as possible. 

It wil be supposed that the experiment is to consist of n 
observations of equal weight in a given range of x. By a suitable 
choice of origin and scale the range may be taken as +1 to — 1. 
From (8.1.3.2,3), 


(var us (c)) /o? = x7 ^x = x"'(XWX7)-! x. (1) 
de la Garza, in the reference quoted, establishes the important 


result that it is possible to find p+1 values En with | £.| < 1, and 
p+! positive values w; with Zo, = n = Xw,, such that 


BSE = XWXT, (2) 
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where the elements of Ë are £i and w is a diagonal matrix. It 
follows that, as far as the variances of the fitted values are con- 
cerned, any experiment gives the same variances as the corre- 
sponding experiment with the p+ 1 coordinates £, and weights w; 
obtained by solving (2). 

Thus to find the optimum design it is only necessary to consider 
the simple cases where the n observations are divided among the 
p--1 points é, with »;(2«,) observations y; at each point. In 
these cases the least-squares polynomial becomes the polynomial 
which passes through the p+ 1 points 7;, Es, where 7; is the mean 
of the n; values y;. The polynomial can be written as 


ED ) (x — £3) -.-(z— Èp) 9 


eee 
ae Se) · — (z— š>) 
. 
p Í = 
or ule) = È — e- (3) 


This is known as the Lagrange interpolation formula. At x — £; 
the coefficients of all the 7 vanish, except the coefficient of 7,, 
and as this is unity u (Et) is J.. 

The variance of the fitted value is given by 


(var u,(x)}/o? = È | lI (x— e|/u Ei-] fre (4a) 


For any of the points £;, 
{var u,(£))/o? = 1/n;, (45) 


and so at best the smallest maximum variance (conveniently 
described as the minimax variance) is the largest of the values 
o*[n;. This is as small as possible when all the z, are equal, so that 


minimax var u (Er) = (p + 1) /n. (4c) 


Clearly, if var us (æ) is less than this value at other points in the 
region —l<2<+1 the minimax conditions will have been 
obtained. Now if £, and £, are the greatest and least of the £;, 
all the coefficients in (4a) increase as x becomes greater than go, 
and also as z becomes less than £,, so that £, and £, must be at 
the ends of the range. The function (4a) has p — 1 maxima in the 
region of interpolation, and so if these maxima occur at the p 1 
points é, then the minimax condition is satisfied. Differentiation 
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of (4a) leads to the equations 


> (En Et) =U’, m= 1 to m I. (5) 
tm 


These equations can then be solved to give the optimum spacing. 

The solutions are given in Table 8.6. For the curve of degree p, 
the observations should be divided into p+1 groups taken at 
values of x equal to 1£,(zy —2,) -- 1(zj--2,), where x, and x, are 
the limits of the range and £; takes the values listed in Table 8.6. 

The maximum standard deviations occur at the points é; 
and from (4c) have the value (p--1)*'e||m. Compared to the 
equally-spaced case, where the standard deviation is p; (k) o| Vn, 
the standard deviation for the minimax case is greater near the 
centre of the range but less near the ends of the range. For the 
straight line (p — 1) the standard deviation is decreased at all 
points except E = 0. 


TABLE 8.6 


Location of observations for minimax variance of the fitted value 


E. = 2(z,— (r L/ (r-. 


Degree p 1 2 3 ES 5 

No. per point nj2 n/3 n/4 n[5 n/6 
S0 +1 +1 +1 +1 +1 
£, —1 0 + 0:447 + 0-655 + 0-765 
Š, ー1 ー0-447 0 + 0-285 
Š, ー1 — 0-655 — 0-285 
& ー1 — 0-765 
Š; -— 


[0-447 = (1/5): 0-655 = 4(3/7); 0-765,0-285 = \{(1 + 2/47)/3)-] 


8.6.1 Calculation of the polynomial 

The fitted polynomial can be obtained in power-series form by 
the expansion of (8.6,3), or by the use of divided differences 
(Birge, 1949). Table 8.6.1 lists explicit formulae for the coefficients 
bp; when the degree p is 1, 2, or 3, and the range of the observa- 
tions is +1 to — 1. 


8.6.1.1 Example 

Table 8.6.1.1 shows the calculation of the power-series coefficients for a 
third-degree polynomial, using the formulae of Table 8.6.1. The coefficients 
are checked by computing the fitted values at the points of observation. 
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TABLE 8.6.1 


š ' : — š — 
Coefficients b, as explicit functions of the observed means J. 


(a) 1st degree 
511 o A) 
bio = (Jo + Ir) 

(b) 2nd degree 
bas = i(Uoc-72:)— Ji 
521 = 二 (7o 一 ya) 
boo = 71 

(c) 3rd degree £ =1/./5 = 0-477 
bas = {€(Go—Fs) — (G1 — Fo) }/2E(1 一 É?) 
521 = — {E (Fo — Gs) — (gi 720/2801 = ë) 
bss = ((#o+#>)— (Zit 99))/2(1 —£) 
530 = —(£* (o + Va) — (Gr + 72))/2(1 — £?) 


TABLE 8.6.1.1 
Calculation of the polynomial coefficients for a cubic curve 


(a) Observed means 


7. 2-07 0-43 2-02 2-01 
i 1 0-45 — 0-45 ー 1 
(b) Surms and differences 
2-07 0-43 
2-01 2-02 
Sum 4-08 2-45 
Diff. 0-06 — 1-59 


(c) Powers of £ 
£— 045 €=0-2025 ë = 0-091125 
2(1—£2) = 1-5950 —— 2£(1— °) = 0-717750 


(d) Coefficients 


b, = — (0-45 x 0-06 + 1-59)/0-71775 = 9-252874 
bg, = — (0-091125 x 0-06 + 1-59)/0-71775 = — 9-222874 
baa = (4:08 — 2-45)/1-595 = 1-021944 
530 = — (0-2025 x 4-08 — 2-45) /1-595 = 1-018056 
(e) Check 
Š, Lbs; £: 
+1 2-0700000 


+ 0-45 0-4299995 
— 0-45 2-0199998 
ー 1 2-0100000 
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87 NOTES AND REFERENCES 


(8.1) The matrix treatment of the least-squares theory is given by Hayes 
amd Vickers (1951). 

(8.2) The choice of the degree of the polynomial is often a, matter of 
individual judgment, and the tests given here should not be regarded as 
binding. Thus on physical grounds the cubic curve in $ 8.2.2.2 might be 
rejected as a representation of the variation of J, since à negative value of 
as implies a fall in J at higher temperatures in the region of extrapolation. 
The fact that the cubie curve gives & better representation in the region of 
interpolation does not necessarily mean that the 'true' curve is & cubic. 

Another difficulty is that one or two very large residuals may dominate 
the sum Xv?, and then only a small change in Xv? is produced by increasing 
the degree of the polynomial (Guest, 1950a). 

If the aim is merely to smooth the observations, the techniques 
described in $ 10.4 may be preferable. 

(8.3) References on the Gauss-Markoff theorem are: Aitken (1933c, 
1935), David and Neyman (1938), Kavanagh (1941), and Cohen (1953). 
A. historical discussion is given by Plackett (1949). 

(8.4) The details of the calculations of the tables are given in two papers 
by Guest (1950, 1950c). 

(8.5) À more detailed account of the representation by two parameters 
cs and x, is given by Guest (1953a); see also Guest (1956). 

(8.6) This section is based on two papers by de la Garza (1954, 1955); 
for the straight line see also Daniel and Heerema (1950). K. Smith 
(Biometrika, 12 (1918), 1) earlier gave a discussion of both uniform spacing 
and minimax variance methods; see also Guest, Ann. Math. Statist., March 
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TABLE 8.8c 


The quantities f; and g; as functions of the parameters & and <, 
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88 
98-F 
LOG 
SLS 
ELS 
orc 
She 
[Pc 
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NAH 
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10-9 
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88.9 
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01:9 
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06-9 
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CHAPTER 9 
THE GROUPING OF OBSERVATIONS 


When polynomial curves are to be fitted to observational data, 
the time required for the arithmetical calculations increases very 
rapidly with the number of observations n. Hence if » is at all 
large it is usually desirable to reduce the computing labour by 
combining the observations into a number of groups, and treating 
the mean value in each group as a single observation. The 
estimates of the polynomial coefficients obtained from the 
grouped sets will be less efficient than those obtained from the 
original observations, and they may also be biased. In this 
chapter these questions of efficiency and bias will be investigated, 
firstly for the case of a series of equally-spaced observations of 
equal weight, and secondly for the general case when the spacing 
between successive observations is non-uniform. 


9.1 EQUALLY-SPACED OBSERVATIONS 


The n observations y(e) are first converted into N groups each 
containing r observations. The sum of the values in a particular 
group will be represented by the symbol y,(e). The values of the 
independent variable e corresponding to the observations are 
spaced at unit intervals in the range 一 き (% 一 1) to +}(n—1) for 
the original observations, and in the range - (N- 1) to - 3(N — 1) 
for the grouped values. Then 


+k(r—1) 
y ()= Z ¥(re +2). (1) 
g-—À(r—1) 
A least-squares polynomial 
a (e) = Es Tiv(e) (2) 


7 こ 0 
is fitted to the V grouped values y,(e). The coefficients A are 
given by the equations 


= = Xs (usto |E The (3) 


Now Bly) = E {Tle J: 710 e 


lI 


xn. [ETs (zi TAinTenlre+2), — (4) 
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where 4j is the coefficient of the orthogonal polynomial of order n 
for the true curve. 
To evaluate this expression it is necessary to expand 
E Tk (re +z) 
z 


in terms of the polynomials 分 (eg) of order N. Taking as an 
example the case k = 3, 


E 分 。(7e +z) = > [(re 4- 2)? (382 — 7)/20} (re +z)] 


l 


Yi? e$ + 8rez? — ((30? — 7)/20} re] 


[eS — (3 V2 — 7)/20} €] — (7?(7? — 1)/10} € 
rT, (e) — (r*(r* — 1)/10} Th (e). 


When these expansions are substituted in (4), E) is obtained 
as a linear function of A} y. This set of linear equations can be 
solved to give A, as a linear function of EC. Thus 


Áo, =r? ELA F 3⁄4 m p" S x]; ete. 
Hence the value 


an = rp $0 — 77?) Hy) 
will provide an unbiased estimate of 4,,, and so from the £y a 


set of unbiased estimates a, of the 4% can be obtained. The 
estimated curve will be 


2pn(e) = $ Ain Tj (e), (5) 
j=0 


the coefficients a, 


in being given by the formulae listed in Table 9.8a. 
In general, 


n 
Ain = rU yg (6) 
Ses 


where ½% is unity and yj is zero for odd values of j--k. For 
polynomials up to the fourth degree the only non-zero coefficients 
other than y;; are yı and yg, These are listed in Table 9.80 for 
values of r from 2 to 15. 

If the fitting is done by means of tables of the orthogonal 
polynomials Ti(e) ($ 7.6.3), then (5) and (6) become 


p 
le) = P Tn(€) (7a) 
p 
and ag, = 1 (SHS Sus, (75) 


stin = E Tinlo) yule) J ETA. (7e) 


91 EQUALLY-SPACED OBSERVATIONS 289 
9.1.1 Example 


In Table 9.1.1 the 62 observations of Table 7.6.2.1 have been grouped 
in pairs (r = 2). The calculations are performed in the same way as in 
Tables 7.6.2.2 and 7.6.2.1a. The quantities a; obtained from the calculating 
scheme correspond to the quantities sr in the notation of this chapter. 

The calculation of the unbiased estimates a from these values Ax is 
shown in Table 9.1.1a. The estimates agree very well with those found in 
Table 7.6.2.1a. From the values a, the power-series coefficients ba, are 
calculated by means of the quantities Ba · 

When the orthogonal polynomials for » — 31 are used with the grouped 
values, the coefficients f listed in Table 9.1.15 are obtained. The values 
for aj, are calculated in the same table. 


TABLE 9.1.1 
The fitting of a cubic to 31 growped observations 


My = Fë (U (-& Soo 31 
811 2480 
@ < Diff. y+ y- Sum & 822 158224 
Sas 9,683308-8 
0 0 — 18 18 0 Bos — 80 
1 1 2 16 14 30 1 B. — 143-8 
8 2 3 18 15 33 ES 
27 3 1 28 22 45 9 a,= A, 8, Xy? 105922 
64 4  —5 10 15 25 16 M,.-.4, 1336 ay, 57577 
125 5 38 45 7 52 25a, 43.096774 Xe$ 48345 
21 6 66 t 9 oo 
243 7 118 124 9 133 49 Mie 4 — 5065 2141 10344 
512 8 一 17 41 58 99 64 ay — 2-0423387 Iv? 38001 
729 9 29 79 50 129 81 
à 5 M, 142993 42 4 8242 
1000 10 一 15 30 45 75 100 ^B. M. 106880 Ee 29759 
1331 11 —40 33 73 106 121 m £, 36113 
1728 12- 一 93 16 109 125 144 a ` 十 0.22823971 
2197 13 一 100 4 104 108 169 — 
9744 14 一 124 4 128 132 196 M; — 1130029 azM, 16663 
3375 15 —122 10 132 142 225 +Bis M, + 728347 xvj 13096 
Sum: 一 262 25328 790 1336 = A. — 401682 
yo 18 as — 0-041481895 
TABLE 9.1.1a 
Calculation of unbiased estimates from the values Ay 
aw — 0041481895 .Za 十 0.22823971 
SN — 2-0423387 Aon 43-096774 
r = 9 
a = 175 ey — 0-002592618 
an = TAn Hll -- Aa} — 0:5113625 
Ogn = 7 * Aan + 0-02852996 
Qon = Tuy + 21-548387 
Boan — 320-25 Bus 57625 
b, = asn 一 0.002592618 51 = Qin + Pass Asn + 0-9826336 
bsg = Qan + 002852996 beo = Son + Born Gan + 12-411667 
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TABLE 9.1.10 


Calculation of unbiased estimates from the values A 


cow 1336/31 = 43-096774 Boo 1 Boon 1 
«iw — 5065/2480 = —2-0423387 Biin 1 Piin 2 
ay 36113/158224 = --0-22823971 Bion 1 Bis, 0:5 
-Z2y 一 334735/6724520 = — 0-049778274 Bs s 0.83r Pian 0-3r 
a = 1 * $ yn(BxxlBssn) Sin r=2 Yy = 3/40 

a = 2-4(2- 82 me —0-007777855 

ain = 2 CN 2 + ohn /32) = - 02556812 

gn = 2-8(2.Z2y) = + 0-05705993 

Gon = 27!(s/x) = 21-548387 


9.1.2 Standard deviations of the orthogonal coefficients 
Since yy is the sum of r observations y, 


c? (yy) = ra*(y), (1) 
while, from (9.1,3), 
(Ay) = c*(yu)/ET$ (e). (2) 


jì 
It is apparent from (9.1,6) that o*(a;,) will depend on p as well 
as on j. However, provided N is not less than 10 or so, the 
variation with p turns out to be insignificant, the contributions 
to of) of the terms v, k > j, being negligible. Thus 


o*(a;,) = 729+) (Ay). (3) 


9.1.3 Efficiencies of the estimated coefficients の 
Since the standard deviation of the coefficient obtained by 
fitting a curve to the n original observations is 20% / TI, (e), the 
efficiency n; of the estimate a, from (9.1.2,2), (9.1.2,3), and the 
expressions for ZT, (e) and ZT$(c), is given by 
(n? —r*) (nt — 4r?) ... (n*— j*r*) a) 


ae 


* (C 1) ( = 4)... m — j) 


1 )+ 1 
or リー ュー ERR REM ーー 


4 (ゲー リ (27ー り (10 が 十 177 十 6) E^ 
360N* ü-r*) 


UG D と の P eare.. (2) 
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From this expression the minimum number N of groups which 
must be retained for the efficiency to exceed a specified value can 
be determined. Table 9.1.3 gives the minimum number of groups 
required to ensure that the efficiencies do not fall below 0-98, 
0-95, 0-90, 0-80, and 0-70. 


TABLE 9.1.3 


Minimum values of N, the number of groups, 
to obtain stated. efficiencies 


Degree j 1 2 3 E: 5 
Efficiency 7; 
0-98 8 16 27 39 53 
0-95 5 10 17 25 33 
0-90 E 8 12 18 24 
0-80 3 5 9 12 16 
0-70 — 4 q 10 13 


The values in Table 9.1.3 have been calculated from (2) by 
neglecting terms . If r is small, a, slightly smaller number of 
groups would be permissible. As an example, for a4 with r — 2 
the value of N for an efficiency of 0-95 drops from 17 to 15. 

For the example of § 9.1.1, 


ns = 27 Sa / Saen = 27 x 9-683 x 108/1253-1 x 109 = 0-989. 


9.1.4 Standard deviations of the fitted values 
The standard deviations of the fitted values 
(e) = Elin T;,(e) 
may be evaluated by expanding the coefficients a, using (9.1,6), 


collecting terms in £y, and using (9.1.2,2). However, it is found 
that, to a reasonable approximation, 


o*[u,(e)] = T») o = ea 7% (/ Sin: (1) 


In the region of extrapolation the term oe) becomes dominant, 
and the efficiency of the fitted value approaches the efficiency of 
the coefficient of highest degree. In the region of interpolation 
the efficiency will be somewhat greater than this value. 

It will usually be sufficient to calculate o[w,(«)] on the assump- 
tion that Y, in (1) is unity. The formula then reduces to the 
standard form, and the tables of p。。( た , n) can be used to give a 
quick estimate. The proportional inaccuracy should not be 
greater than . 
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9.1.5 Estimation of the standard deviation of an observation 


The standard deviation of an observation may be estimated 
from the residuals 


p 
vp le) = e) — Ae Tis (e). 
j- 

From $ 8.1.1 it follows that 

Exvjy() = (パー ター 1) (yy) = (N — p — 1) o%(y), (1) 
and so the expression 

ME NON. 
~ kW-g-1)) 
will provide an estimate of o(y). The quantity Dv?,(e) may be 

calculated from the formula 


ご ゆ y(e) = XyN(e) -E iy ETi(). (3) 


(2) 


Another estimate of o(y) may be obtained from the residuals 


の pa(e) = le) - Xa Qin Lale). 


It will be shown in $ 9.1.5.1 w. that 
EXv$ (e) = |n-»- 1- X ((1/m) — 1| o?, (4) 
j 


In the present case, from (9.1.3,2), the last term in the square 
brackets is found to be approximately p*/12N?, and so it can be 


neglected. Hence Se。(9 |? 
Spn = [me — M! (5) 


will provide an estimate of c(y). 

Since 65 is very close to the least-squares estimate, vs?,,,/o” should 
be distributed at least approximately as xy? with v = n—p—1 d.f. 
The distribution of spw will be similarly related to the x? distribu- 
tion with v = パー カ ヵ ー1 d.f., and so the relative efficiency of this 
estimate will be, from (2.4.1,3), 

(パー ター1)/(%ー タ ー1) キ 1/7. 
The estimate so is then rather inefficient, but it can easily be 
calculated by means of (3), while there is no comparable formula 
by means of which % could be obtained. 


For the example of § 9.1.1, from Table 9.1.1, Xe24(e) is 13096, 
and so (2) gives 


Say = {13096/27 x 2}t = 15-6. 
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The value found by fitting à curve to the original observations 
is 11-4 (Table 7.6.2.1a). 
9.1.5.1 Relation of certain least- squares estimates to estimates of 
lower efficiency. First it will be shown that, if aj is the least- 
squares estimate of the orthogonal polynomial coefficient A, and 
a; is any other unbiased estimate obtained from a linear combina- 
tion of the same observations y;, then for any linear function f of 


the a;, E(f—f*)? = E(f- P): — E(f*— F}, (1a) 
where f = Xa; * = DA; aj, F =A; A;. (15) 
For 


E(f-f*y5-H—-Ff-E(f*-Fp-2E(f-F)g*—PF) (2) 
and E(f— F)(f* — FP) = E(A,(a; —A,)) (ZA (ag - A)]. (3) 


Now, a, is of the form 


and, since a; is unbiased, 
E(a;) = A; = Xy) E(yQ) - > Ú (z) > A, T;(2;). 
Hence it follows that 
> J (z) Telti) = 8; 
where 3;, is the — delta. From (3), 
E(f—F)(f*-F)= AN Az > 1K ) ae, II( rg) / To. T (2,)) o? 
. [Eu T) 
- "E =i}, 


and on substituting this in (2), (1a) is established. 
In particular, 


E(a; — a5 = o*(a;) — o? (ay) = (1/9) — 1} e*(a7). (4) 


For the residuals in the two cases 


Laos vi Ew, vt? = Xw,(y; Ta, Tí(z;))* Tub. (g — LaF Tí(x))* 
= > [— 2(a; —aj) Xw y; Dt) 
" + (a? — af?) Zw, T(x)], 
or Ew, vt — Ew; vr? = > (a; — af)? Zao, TF(x;). (5) 
On combining (4) and (5), 
E[Zw, v — Ew, vf] = X ((/) — es, 
2 
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and so, since * 2 
' ExXw, vf? = (n --= I) os, 


gzw st = -v «(am =I. (6) 
3 
This is the result (9.1.5,4) used in $ 9.1.5 above. 


9.1.6 The dropping of observations before growping 

If the number of observations % is prime, it will be necessary to 
drop one or more observations at the ends of the range before 
grouping. The standard deviation of a, is proportional to n-6-*9, 
Hence if the number of observations is reduced to »' by dropping 
v observations before grouping, the efficiency of the estimate a; will 
be reduced by the factor (n’/n)/+4. This factor may cause a con- 
siderable drop in efficiency. For example, if one observation is 
omitted when x is 50, the efficiency of a, is reduced by the factor 
0-868. Table 9.1.6 shows the relative efficiencies of the coefficients 
a; for various values of n when 1, 2, and 3 observations are 
omitted. 

The efficiency of the grouped estimate a,, is then the expression 
(9.1.3,2) multiplied by the factor (n'|n)*/*1, 

When the 62 observations of Table 7.6.2.1 are reduced to 
15 groups, the two end observations must be omitted. The 
efficiency of the estimate a, will be S33y77/S33,, which is, from 
Table 7.106, 0-749. 

The effect on the fitted values of dropping observations can be 
found by means of the tables of the functions p, (k) (Table 8.8a). 
The efficiency of the fitted value at the point e will be given by 


が ee 
w“ (J = —(—9—] ， 1 
alus (e) = . (B (1) 
where (assuming the observations are omitted symmetrically 
from the two ends of the range) 


K = 2e/n’, v even; 
k’ = (2e+1)/n’, v odd. 


Ppo(k) varies only slowly with k for a considerable part of the 
region of interpolation, and so in this part the efficiency of the 
fitted value is close to n’/n, the efficiency of the coefficient ap. 
Beyond a value of |k| given in Table 9.1.6.1 the variation of 
Pyo(k) with k becomes very rapid, and the efficiency drops sharply. 
For large values of |k| the efficiency approaches that for the 
coefficient a. 
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TABLE 9.1.6 


t 


Relative efficiencies of a; when v observations are dropped from 
the original set of n observations 


M OU Im * * 


ooooooooo 
«o «o «D €O XO 00 Ç G -1 
Qo -1 O» Wf» bO GG Qt — LO 
Qo O> = = LO Ot «105 tO 
23222222282 
© O O 228 
O0 OQ» HM T 00 02 «D L3 — 
- 0» Qi — mM Oe 
282222225 
SS «o «5c 5050 -1 
C Qt G> O Qo n «1 
—1 
299999999 
«o cO cO «D 00 00 -1 -1 Qt 
0o O See 
Q — Ot i i Qt i= DO 


に メー ミー ミー ドー ミー ミー ミー ミー 


TABLE 9.1.6.1 


Range of | k | within which the efficiency of the fitted 
value approximates to n' [n 


Degree p Range of | ん | 
2 0 to 0:50 
3 0 to 0:70 
4 0 to 0:80 
5 0 to 0-85 
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92 STEP FUNCTION METHODS 
The use of step functions for the estimation of the slope of a 
straight line was discussed in $ 6.4. Similar methods can be used 
to estimate the coefficients for higher degree polynomials. 


9.2.1 Second-degree polynomials 
To obtain an estimate bez of the second-degree coefficient, a 
function W,(e) is required such that 


>W,(e) = 0 (la) 
and >W,(e) e = 0. (15) 
The estimate is then 
bee = 2W,(e) y(e)/ L Hale) (2) 
amd its standard deviation is given by 
hae) e} - 


A - le) 
Condition (15) is satisfied if W,(e) is an even function of e. Condi- 
tion (la) requires that the values W,(e) should fall into two 
groups, one with W;(«) positive and the other with W,(e) negative. 
The appropriate step functions will be such that, for any arbitrary 
function f(e), ZW;(e)f(e) is of the form 


Í in—1) k(a,—1) k(a,—1) k(a,—1) 
[lal A ^ 2 )+a( a2 = 2 J+- 
lsin 5 -ia-1  —ia-1 


la ("x^ _ s. )+n( EDU _ a i )+ el [fe]. (4) 


し ーー) Ab ー#( の ュー1)  —à(5,—1) 
1(a;— 1) and 365, 1) are the values of e at the boundaries of the 
steps. The functions will be called single-step functions if there is 
one step in each group, double-step functions if there are two steps. 
The expression XW,(e) es will contain terms 


#( の ー1) 
= a,(a?—1)/12 
—i(2—1) 
for which the approximations n° o2/12 will be used, where x; = a,/n 
is the parameter specifying the boundary of the step. Since for 
the least-squares estimate 


ce*(y)/o*(b3,) = n(n* — 1) (n? — 4)/180 = 15 / 180, 
the efficiency of the estimate b,, is, from (3) and (4), 


5 Rg(1 — o3) + ...} — (r(81 — 85)... 
Me) =a AAAG OO 
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The values g, 7, x, 8, for maximum efficiency can be determined, 
subject to the condition (1a) 


2101 — a) + ...} — (r1(£1 — Ba) T. J = 0. (55) 
The optimum values are listed in Table 9.2.1 for single-step and 


double-step functions. The corresponding efficiencies are 0-8958 
for single-step and 0-9630 for double-step functions. 


TABLE 9.2.1 


Values of parameters for maximum efficiencies 


Second-degree coefficient Third-degree coefficient 


Single-step Double-step Single-step Double-step 
functions functions functions functions 


0-7363 0-8482 0-8621 
0-6757 

0-4414 0-5007 0-7024 
0-3207 B, 0-1205 


1:3042 1:5774 1-0393 
0-7590 

0:7793 0-4762 0-5573 
0-8875 

52 0-8958 0-9630 0-9014 


9.2.2 Third-degree polynomials 
To obtain an estimate ba of the third-degree coefficient a 
function W,(e) is required such that 


XW4(e) = 0 = 2>W;(e) eè, (la) 
XMA(e)e = O. (15) 
The estimate is then 
bas = 21W,(e)zy(e)/2W,(e) es, (2) 
amd its standard deviation is given by 
oy) _ EWOP (3) 


o (g) * ZWS$(e) 
Condition (Ia) requires that W,(e) be an odd function of e. Pro- 
ceeding as in § 9.2.1, the efficiency of the estimate is found to be 
given by the expression 


_ 175 [í (1— 4) +...) — {r(t — 89 +...) 
nbs) = Ga ((H o+ 3*8 A-ROT-)^ (4) 
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The values of the parameters which make this expression a 
maximum, subject to the condition (15) 


(gi (1 — a3) T J- C101 B2) +...) = 0, (4b) 
are listed in Table 9.2.1. The maximum efficiency for the estimate 


bs, is 0-9014 for single-step functions and 0:9473 for double-step 
functions. 


9.2.3 The polynomial coefficients 
Estimates b,, of the polynomial coefficients can be obtained 
from linear functions of the quantities 


brr = Tele) y()/ZW,C) e, (1a) 
where EZW,(e)e" = 0, m < k. (15) 
For if the estimates b are to be unbiased (cf. $ 9.5), 
p 
ve) = NO È bor. (2) 
On dividing this equation by ZW;(e) e, it can be put in the form 
p 
bis = by > Oi byx⸗ (3) 
j+1 
p 
or 555 = b;;— >; ik bpr 
171 


By continual expansion of the terms biz, this equation can be 
put in the form 


p 

D = i Dy 4 
pi PE kk (4) 

Zy is unity, and 8% vanishes if j+ k is odd. For the second- and 

third-degree polynomials, 

b20, b30 = boo + Boa bez, bsə = b22 


bs, = Di 十 BasDss， bel = b, 
where 


o2 De /n = (12 — 1/12, B, Me) 7 所 (<) e. 


9.2.4 The fitted values 
The variance of the fitted value 


の 
u (e) = Z bp 
j-0 


can be found in terms of the variances and covariances of the 
beg, and the efficiency by dividing this value by the corresponding 
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least-squares variance. The efficiencies are very nearly equal to 
the efficiency of the quantity b, in the region of extrapolation, 
and are somewhat greater than this in the region of interpolation. 


9.2.5 Tables of step functions 

From the values « and 8 given in Table 9.2.1 the numbers of 
observations in each step can be found. Thus for the step (oj, «;.1) 
the number is 


$(a; — 1) — 261 — 1) = nag ) 


The weights can then be found from the conditions that 
=W;(e) e = 0 for k<j. The functions W;(e) for j = 4 and j = 5 can 
be determined in a similar way. 

The optimum single-step functions are given in Table 9.8c for 
polynomials of degree p < 5, and for values 2(1)75. The quantities 
BH and ZW;(e) e are also listed. For the tabulation of the function 
W;(e), the observations are supposed numbered by the value of | e | 
if n is odd, and by the value of |e|-- if n is even. Thus for 
62 observations the numbers are 1 to 31, for 63 observations 
0 to 31. For coefficients of even degree observations of equal | e | 
are added, for coefficients of odd degree they are subtracted. 
This is indicated by the suffix + or — under the summation sign. 
The expression Za means the sum of all observations numbered 
0 to a. 


9.2.6 Example 


Table 9.2.6 shows the calculations for the cubie curve fitted to the 
observations of Table 7.6.2.1. The quantities W,, ZW, ei, and Bp; are first 
entered on the right of the calculating scheme from the tables. The 
observations are entered at the left, the observation for the largest value 
of e being at the bottom of the z+ column. 

Lines are drawn to indicate the sums Ta required. The sums of the 
corresponding observations are added starting from the top, the progressive 
total being entered in the > column wherever a line is drawn. The 


T 
differences are then added, the progressive totals being entered in the > 
column. As a check, the final Y total should be Xy, --Zy---y, and the 
一 
final Y total Xy,.— Xy-. The calculations of the polynomial coefficients are 


then carried out at the right of the scheme. 
The efficiency of the estimate bz, is, from (9.2.2,3), 


(16151 x 10°)? 


2 — ——— ahha cac. Dmm ROO 2 * 
(ZW, c= S, = (51172436 x 582) x 1258-1 108 ^ 9 903 


The value given in Table 9.2.1 is 0-901. 
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TABLE 9.2.6 
Calculating scheme using single-step functions 


Z 
8 


31/62 = Do 21-548387 


Boz 一 320.25 Bog 
boo TL Bos b22 +Êoa ba = bpo 12192375 


W: (223) 42 14 


> W, e 74928 
一 


5。。 0-029214713 


B24 
bas L B24 ba = bpa 0029214713 


SD n a w c tomo 


M: 
> W, et 
bis 
(231-5 19)/se1 

= bu 031823461 
Bi; —530-25 ps 
5 ＋ Bis bas + Bas bss = 5% + 1:0113728 
W,: 117( 531- zz) 

—58(5 22-5 4) 

EW, eè 16,150680 
ba, — 00025075105 


Bas 


bas + Bas bss = bpa —0-0025075105 
W: 
EW e 


bss 
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93 GENERAL SUMMARY FOR THE 
EQUALLY-SPACED CASE 
Table 9.3 gives a, summary of the solutions by different, methods 
of Example 7.6.2.1 on coded sugar prices. The time taken for 
each method by an experienced computer is also shown. 


TABLE 9.3 
Solutions of Example 7.6.2.1 obtained by different methods 


Least-squares Step function 
methods methods 
62 31 15 Single- Double- 
observations groups groups 


— bzs x 105 
bz x 102 


bs, x 10 
bzo 
Minutes required: 
by machine 
by logarithms 
Efficiency of bzs 0-989 0-749 0-903 0-949 


An examination of Table 9.3 shows that the reduction in time 
brought about by the use of grouping methods is not as large as 
might have been expected. More significant is the reduction of 
strain on the computer, since the multiplying factors are smaller 
in magnitude and fewer in number and the chance of making & 
mistake is much reduced. In fact, the step function method is 
almost foolproof, except for the possibility of copying errors. 
Step function methods can be used even when no calculating 
machine is available, the quantities Te) y(e) being obtained by 
simple addition and the coefficients b„; by logarithms. 

The coefficients obtained for N = 31 are close to the values for 
n = 62, while the coefficients for N = 15 are somewhat different. 
Since in the latter case the two end observations have been 
omitted, this would indicate that the deviations from a smooth 
curve are not entirely random in this example. This, of course, 
would be expected from the nature of the data. However, the 
differences between the various estimates are usually less than 
the standard deviations. 


9.4 UNEQUALLY-SPACED OBSERVATIONS 


Following the treatment of Ch. 8, the values z; will be replaced 
by the smoothed-out set 


Xu = kin 745 (et) 2 kon Tu (et) * kon 735 (et), (1a) 
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where = , 
* = X T$, (./ UT (oh. (5) 
る t 


If the n observations are converted by grouping into N = n/r 
values 


ic—1) 
let) xs > y» (re; +2) 
タニ ー#(⑦ー1) 
at points ty; = , (re, + 2), 


the smoothed-out system for the grouped observations may be 
written 
Xy = kin Tin let + kon T Ale. + kw T$u(e;). (2) 
The values k;y may be found in terms of the k;, by using the 
expansion of CT (rer z) as a series in T%y(e;) (Guest, 1954). 
In fact, ? 
kiy = [kin TGT. — 1) ksn] 
bay = Ah | (3) 
kay = 74 kzn 
The scale factor 
$ SS Us + (n2 +1) ky) (4) 
is now removed from (1a) and (2), giving 
Xu =s $^ (ks Tin(et) T n Kon Tš,(e) T 2n-* Kan 735 (62); (5a) 


Xy; = PO Tiu (e;) +N xay Té (e;) + 22N? E Tino) à) 
5 

Then, by comparing (la) and (5a), (2) and (55), and using (3) and 
(4), 

Kay = Kan Kan = Kg; Kin = l— C- $N 7 kay. (6) 
Hence the grouped variable (5b) is described by the same two 
parameters x, = xs, and x5 = xs, as the ungrouped variable, n being 
replaced by N in the various equations. 


9.4.1 Least-squares curve fitted to the grouped estimates 

When a least-squares curve is fitted to the N observations 
Vui ni, the standard deviation of the orthogonal coefficient a; 
any var Ajy = Var Yy/ ET (£y). (1) 
An approximate value for this expression can be found by replac- 
ing the zy; by the smoothed set Xy; and using the formulae of 
$8.5.4. Thus 


var ajy = (f/r?) (NR) f,(Y — N 7 g;))? var yy. (2) 
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A similar expression, with » replacing N, holds for var a;,. It 


will be assumed throughout this chapter that » is sufficiently 
large to permit the neglecting of terms of order n-2. Then 


(vara;,)/(var ajy) ν (1 — Nh, (3) 
and the efficiency of the estimate a is given by 
(a, y) =1 g,. (4) 


の has been tabulated in Table 8.8c. From these quantities the 
efficiencies for polynomials of the first, second, and third degrees 


TABLE 9.4.1 


Percentage efficiencies for suggested values of N 


Ki 
K3 ° e 0-5 
lst-degree polynomial 
naw) N = 5 x 96-6 96-0 94-8 
2nd-degree polynomial 
7T(aayv) = 9 . 96-5 93-8 89-7 
N = 12 . 98-0 96-5 94-2 
3rd-degree polynomial 
7(asv) N = 16 . 97-5 94-5 90:0 
N = 21 . 98-5 96-8 94-2 
K 0-5 
K3 x — 0-5 0 0-5 
lst-degree polynomial 
(ay) N = 5 6-1 95-5 94-2 
2nd-degree polynomial 
(Gen) N = 9 e 95-0 92-3 88-1 
N = 12 . 97-2 95-7 93-3 
3rd-degree polynomial 
( N = 16 = 95-8 92-8 88-3 
N = 21 . 97-6 95-8 93-2 
3 
K3 : — 0-5 0-5 
Ist-degree polynomial 
n(n) N = 5 . 95-7 95-0 93-7 
2nd-degree polynomial 
(N N = 9 ° 93-6 90-7 86-5 
N = 12 。 96-4 94-8 92-4 
3rd-degree polynomial 
Tm (ass) N = 16 . 94-3 91-1 86-5 


N = 21 96-7 94-8 92-1 
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can be determined for various values of N. Clearly the larger 
the value of N the higher will be the efficiencies, but also the 
longer will be the time taken to calculate the fitted polynomial. 
Some compromise is necessary, and it appears that suitable values 
of N lie in the range 9 to 12 for à second-degree curve, and in the 
range 16 to 21 for a third-degree curve. For a first-degree curve, 
5 groups are sufficient. The efficiencies for these suggested values 
of N are shown in Table 9.4.1. 


9.4.2 Bias of the estimates 


If the polynomial is of the second or third degree, grouping will 
usually lead to bias in the estimates. The origin of the bias may 
be seen by considering the power-series representation. Thus if 
the ‘true’ curve is LB., the expectation of the observation y, 
corresponding to a given value z; is 


E(y;) = > Bp. 
7 
Hence E(yy;) = > By; La, 
j g 
where the suffix z indicates summation over the r values z; in a 


particular group. Now 


DEL rix x) 


unless j is 0 or 1, and so 
E(yyj)** E (1779 B, zh. (1a) 


The true value for the grouped curve is 
By = rt By, 
and so (1a) becomes 


0 vn. +0. (16) 


Because of this inequality the estimates obtained from the 
normal equations 
DN. Lb yin Thi) zk, = 0 


will be biased estimates. 

It is more convenient to calculate expressions for the bias in 
the orthogonal coefficients a,, rather than the power-series 
coefficients b, though the arithmetical procedure is still very 
complicated even for the orthogonal coefficients. The bias in au 
is defined to be the difference between the expectation and the 


94 UNEQUALLY-SPACED OBSERVATIONS 305 


true value, (av) - Ax. The detailed calculations will not be 
given here. The bias is found to be given, to order N-?, by an 
expression of the form 


D 
N E の (の Nr2y-* A jN? (2a) 


where the g, are functions of x, and x. 

From (8.5.1,5), n is approximately the range of z,,. Hence 
$^ Nr? is approximately the range of xy; Thus the estimate of 
bias can be written as 


p 
NXg jk (Ra Aix. (2b) 


The ratio of bias to standard deviation will be more useful 
than the actual bias in deciding whether the grouping will be 
satisfactory. From (9.4.1,2), this ratio is given by 

Biasa, 1 
"o - sx パー 一 Gj, Ajy(Ra zy), (3) 
where oy is the standard deviation of a grouped observation /s; 
and G;, is a function of the parameters x, and xg. Gy; and Gi; 
vanish, and so for the third-degree polynomial the bias depends 
only on A, and As, while for the second-degree polynomial it 
depends only on A,. Selected values of G;; are given in Table 9.8d. 
9.4.2.1 Checking for bias before grouping. It will often be desir- 
able to ascertain, before proceeding with the calculations, whether 
the grouping will give rise to a significant bias. In terms of the 
observations before grouping, (9.4.2,3) becomes 
Bias a 
S.D. agy 
where c is the standard deviation of an observation y; and A; is 
written for 4½ (Ra æ, .). 

The values Aj can be estimated from the five values of y; 
spaced at intervals of one-quarter of the range of z;. If these 
values are denoted by y... Y+} Yo: y V, then 


A; = (Y+ y — 29); (2a) 

As +Y ) 2944 — 9-0) (25) 

These are actually the estimates for an equally-spaced curve pass- 

ing through these five points, as derived in $ 8.5.2. If the scatter 

of the observations is large an average value of y in the particular 

region should be taken. c can be estimated from the scatter of 
the observations and x, and ks from (8.5.2,4a—c). 


= N- z6, A; (1) 


21 
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9.4.8 Example 


Table 7.1.1 contains 67 observations. If it is desired to fit a cubic curve 
using grouped values, these observations can be grouped to give the 17 
values shown in Table 9.4.3. The fitted coefficients can then be calculated 
using the Doolittle technique, the values obtained being listed in section 
(b) of the table. It is seen that the results agree very well with the values 
a*, and bf, obtained in Ch. 7 by fitting a curve to the original observations. 
The efficiencies are listed in section (c) of the table, and are compared with 
the values 1 — N-? g, obtained from Table 8.8c for xs = 0:3, ks = 0-6. 


TABLE 9.4.3 
Grouping methods applied to the example of Table 7.1.1 


(a) Grouped observations (N = 17) 


の y c y c y x y 

十 110.71 387 +40:43 282 一 2.65 446 一 29.88 622 

十 92.40 298 十 25.88 228 —7:20 438 — 35:59 706 

+65:37 376 +18-25 272 ー14.98 475 — 46-32 891 

455-23 295 +8-98 314 —24.12 566 — 57-07 1110 
+3:05 379 


(b) Coefficients a, and 6。, 


j a}, ri-1 ayy be, 71-1 byy 
0 92-4 +44 93-0 

1 —3:59 +025 — 3:59 —5:57 4 0˙48 — 5-60 
2 十 0.261 240-020 十 0.264 + 0-407 + 0-040 + 0-401 
3 — 0-0074 + 0-0018 — 0-0072 52 = as 


(c) Efficiencies of the estimates ajy 
j zT. ET ZTjy|rti-1 T, 1—g,/N? (Table 8.8c) 


1 9265 36861 0-9946 1— 1-46/289 — 0-9950 
2 143-66 x10* 8922 x 10* 0-970 1— 9-9 /289 — 0-966 
3 1:913x10* 1780x108 0-909 1—31-1 /289 = 0-892 


The order of the bias in the estimates a;y can be found from equation 
(9.4.2,3). The value of oy obtained from the residuals is 37. In § 8.5.2.1 
it was found that x, = 0-54, ks = 0-58. From Table 9.8d, with <š = 0-5 and 


8 Ga 0-09, G 0-04, Gog 0-00, 
G 013, 6, 0-07, Gg ~ 0-03. 
The range of zy is 168, and 
Qay (Ra zy)? = 1.87 * 10, aa (Ra zw)3 = — 2-14 x 108. 
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Thus 
Bias ai / S. D. ayy = (0:09 x 1-87 — 0-13 x 2-14) x 102/37 x 17417 = — 0-04, 
Bias qx / S. D. aay = (0:04 x 1-87 — 0-07 x 2-14) x 103/37 x 17417 = — 0-03, 
Bias qa / S. D. asx = (— 0-03 x 2-14) x 108/37 x 17417 = — 0-02. 


The bias in each coefficient is negligible. 

The bias before grouping could have been checked by means of equation 
(9.4.2.1,1). Since the range of x is 45, rough values of y at z = 30, 19, 8, 
— 4, — 15 are needed. These values are 


Y+ = 110, yap = 80, yo, = 50, /: = 120, y., = 290, 
and so from (9.4.2.1,2a,5) 
A; = 2(110--290— 2 x 50) = + 600, 
A; = 4$(110— 290— 2 x 80 + 2x 120) = — 550. 
Then, if c is taken as 20, 
Bias ai / S. D. ayy = 467(0-09 x 600 — 0-13 x 550)/20 x 289 = - 0-02, 


which is of the same order as the value obtained from the fitted coefficients 
AN- 


9.4.4 Grouped observations of different weight 
Often it is not possible to find a suitable pair of values such 
that » — Nr. More usually, 


n = Nr-rv, (1) 


where v is small. The v additional observations should be included 
in v groups near the centre of the range of z, and in forming these 
groups the sums of the z and y values must be multiplied by the 
factor r/(r+ 1) to bring them to the same scale as the other groups. 
If v is negative the factor is r/(r—1). For example, the y values 
in the central group of Table 7.1.1 are 99, 96, 89, and their sum 284 
is multiplied by 4/3 to give the value 379 in Table 9.4.3. 

These v groups should strictly be given a weight (r+1)/r in 
forming the moments and the sums of the powers. This weighting 
greatly increases the time required to evaluate these quantities, 
and since the reduction in efficiency due to the omission of these 
weights is negligible, it is recommended that the grouped observa- 
tions be treated as if they were all of equal weight. 

If the original observations have different weights w, Zw; 
replaces n in (1), each observation of weight w being regarded as 
equivalent to w observations of unit weight. The observations 
are divided into N groups each having the same value of Cu,. 
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9.5 STEP FUNCTION METHODS FOR THE 
UNEQUALLY-SPACED CASE 


If the symbols W;(z) represent a set of p + functions, then 
50 Wiad) = Z We) Boat (1a) 


where the B,, are the coefficients of the ‘true’ curve. In matrix 
notation this equation is 
E{Wy} = WX7 B, (15) 
where W is the (p+1)x matrix whose elements are W;(x;) and 
X the (p+ 1) x matrix whose elements are ag. Then 
E(WX7)? Wy} = B, 
and so the quantities bx satisfying 


(WX7) Wy = b (2a) 
will be unbiased estimates of B,,. Equation (2a) is equivalent to 
Wy = WX? b, (2b) 

which when written out is 
> box ZW) z£ = > W(z) Yi- (2c) 


These equations correspond to the normal equations in the least- 
squares case, and their solutions will provide unbiased estimates 
of the power-series coefficients. 

The functions W;(z;) to be considered in this section will be 
step functions. There are very many types of step function 
which could be used, but only the simplest ones will be discussed 
bere. Attention will be confined to functions W(x) which are 
independent of the degree p of the polynomial, and W(x) will be 
chosen to maximize the efficiency of b. Only single-step func- 
tions of the simplest type will be considered. 

The form of the optimum function er) will clearly depend 
on the distribution of the values z;. However, the determination 
of the optimum function for the particular set of values in each 
example would complicate the method intolerably. The optimum 
form will be determined for the equally-spaced case, and the 
same form will be used in the general case where the spacing is 
non-uniform. 


9.5.1 The second-degree polynomial 


The function W(x) will be taken equal to unity everywhere. For 
the discussion of the equally-spaced case the function W,(e) will be 
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chosen, by analogy with the orthogonal polynomial 7;(e), so that 
for any arbitrary function f(e), 


> Wale) F(et) 
is of the form 
L je” "> | [S 
2 —ki(n— ld) M . Hib- MI fo. tu 


The numbers 4(a—1) and は (5ー1) are the values of e at the end 
of each step. The parameters = = a/n and B = b/m will be intro- 
duced, and the approximations 


1(a—1) 364—1) 


= &=a=on, > e= mala 1) ens, 
—k(a—1) —i(a—1) 
k(a—1) : ia-1) 
2 È e= 4a- 1) 4 n, 2 Y; & = Z;(a2°— 1) 2 Nnt, 
0, 4 


will bs -— Thus 


EW, ee = An ((I 一 an) — rf}, (2a) 

EW, = n(g(1 — o) — rB), (2b) 

EW = ní(q*(1—2o)-r-7?B)], (2c) 

while ZW, = qum, (3a) 
DN = n = LW. (3b) 


W, amd W, are even functions of e, while W, as defined in $$ 6.4.3 
and 6.4.1.1 is an odd function of e. Hence the ‘normal’ equations 
(9.5,2c) for even values of k are 


520 PW, + z ZW, e? = TM z, (4a) 
bag = 5 十 6。。 xW, e? = N. (40) 
These equations will give, on substituting from (2a—c) and (3a, b), 
an expression for b,, in terms of the parameters g, r, x, 8. The 
efficiency of the estimate bz may be evaluated by comparing its 
variance with the value 5/180 for the least-squares estimate. 
It is found that 
PPE a il eL (5) 
* 4 (gu — ax) +7? B}— {Q(1 — a) — rp} ` 
The values of the parameters which make this expression a 
maximum are 
œ = 0-776, B=0-497, g=1-143, r = 0-988, 
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the efficiency being then 0-903. In practice, it is more convenient 
to use the values g =r = l, and this reduces the efficiency to 
0-902. 'The groups, then, will be given equal weights, and there 


vum 34 — 1) - 4a—1) = 4n(1—2) = 0-11n 


observations in the extreme groups and 0-50» observations in 
the central group. 


9.5.2 The third-degree polynomial 
The function W,(e) will be chosen, by analogy with 7,(e), so 
that for any arbitrary function 


=W,(«)f(e) = 40 S -2] 


$(b—1)  £(b,—1) 
-一 全 


-"*)ue-^-4 0 


0, à 0, 
As in the previous section, parameters x = a/n, B, = b,/n, B, = bajn 
are introduced, and these are adjusted to maximize 7(b,;). The 
values obtained are 


a = 0-859, 81 = 0-697, 8。= 0-117, q= 0-297, r= 0-153, 


the resulting efficiency being 0-902. It is more convenient to take 
q = 2, r = 1, the reduction in efficiency by reason of this choice 
being negligible. Of course, only the ratio of q to r and not the 
individual magnitudes is significant. The adopted step functions 
will then contain 0-07» observations in the outside groups and 
0-29n observations in the central groups, the two groups being 
weighted in the ratio 2:1. 0-08» observations between each 
extreme and central group, and the 0-12» central observations, 
are omitted. 


9.5.3 Tables of step functions 


To specify the step functions for a given value of z, the obser- 
vations are supposed numbered in decreasing order of x from 
1 to n. The symbol En; represents the sum (of af or y;) for all 
observations from 1 to »;,. The number n- is denoted by the 
symbol nių} Table 9.5.3 gives the recommended step functions in 
terms of the »;,. The nj, are given as functions of n in the lower 
half of the table. The integers nearest those shown in the table 
would be used in a practical example. 

Table 9.8e gives directly the step functions for each value of n 
between 10 and 100, without the necessity of calculating z, from 
Table 9.5.3. 
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TABLE 9.5.3 
Recommended step functions for the unequally-spaced case 
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Zero degree: Xn; 


First degree 

Second degree : 

Third degree 
Ny, : 0-33n : 
Ng, : O-OTn; 
222 ょ 1 2 一 27 た 


Nga : 0・117: 
Nag: 0-157 : 


En; + n- Dn; 
Ena + ENa — Xnj,— Eng, + Xn; 

: 257; + Ena 一 Xn34— Ens, + Xn$, + 
Noo : 0-25n; 
nas: 0-442; 


DATI 


3 や ヵ 31 一 


En. 


9.5.4 Example 


The method of obtaining the ‘normal’ equations is shown in Table 9.5.4 
for the observations listed in Table 7.1.1. 
The sums to be calculated are first entered from Table 9.8e. A separate 
table of values 27), y is formed, the óbservations being listed in decreasing 
order of z and suitable powers of 10 removed to bring the values to the 


Degree 
Zero 
First 
Second : 
'Third 


ご (67): 


TABLE 9.5.4 
Solution of Example 7.1.1 by use of step functions 


X(92) + X(45) — (67); 
E(7) + X(18)— X(51) — (60) (67); 
: 25(5) + £(10) — £(30) — (37) + £(57) + 28(62) — 2X(67). 


Factors removed: x, 107, 9 = 1l; y, 107, r = 2. 


(a) Partial sums 


Ex Zr Xa xx Ey Check 
22 37-823 75.755047 169-357190 17:45 322-385237 
45 40-341 77.912973 170-132765 38-47 371-856738 
7 18-370 48-513126 128-922157 6-19 208-995283 
16 32-371  70-626595 164-386125 13-56 296-943720 
51 37-059  79-771697 169-048687 46-61 383-489384 
60 29-407 86-410847 163-162986 61-96 400-940833 
5 13-627 37.257289 102-191885 4-12 162-196174 
10 23-694  58-004464 145-921859 8-93 246-550323 
30 41-404 77-466790 170-218818 22-89 341-979608 
37 41-924 77-545716 170-230401 29-61 356:310117 
57 32-377 83-442129 166-157945 56-11 395-087074 
62 27.139  88-983209 160-244907 66-26 404-627116 
67 20-173 98-726409 146-564412 79-90 412-363821 
(b) ‘Normal’ equations 
Zero 67 20-173 98-726409 146-564412 79-90 412-363821 
First O 57-991 54-941611 192-925543 一 23-98 281-878154 
Second —21 4-448 51:683586 107-661021 — 8-92 133-872607 
Third 0 13-929 41-462265 203-375345 — 6-50 252-266610 
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order of umity. Lines are drawn aeross the table to indicate the partial 
sums required. The columns are summed and the partial sums recorded 
in part (a) of Table 9.5.4. These sums can be checked by summing across 
the rows, allowing the entries to accumulate till a sub-total to be checked 


is reached. - 
The ‘normal’ equations are then formed by combining these partial 
sums. For example, the first-degree entry for Xx is 


(22) + (45) (67) = 37-823 + 40-341 — 20-173 = 57-991. 
The entries for each degree are checked by comparing their sum with the 
check column entry. 


9.5.5 Solution of non-symmetric equations 

The normal equations obtained in the step function method are 
non-symmetric, and so they cannot be solved by the Doolittle 
technique. However, the method of single division can still be 
used. Probably the safest scheme is that given in Table 7.1.1, 
with the addition of a check column. 


TABLE 9.5.5 
Compact method of single division 


6510 ou 12 M, C, 
の 。。 6521 22 M, C, 
Og Ci C; 

Soo/l ex og Go Co 
10 51/1 œg ay € 
20 Say Sal d 02 

co e ca 


For more experienced computors, an abbreviated scheme is 
available, based on (7,1.2,6a-c,7a,6,8). This scheme, called by 
Dwyer the compact method of single division, is shown in Table 
9.5.5. The first column of the lower matrix, identical with the 
first column of the upper matrix, is written down. The first row 
of the lower matrix is then calculated by division of the first row 
of the upper matrix by Sq, The second column is then calcu- 
lated, using (7. I. 2, 64), and the second row, using (7.1.2,6b) and 
(7.1.2,6c). The remaining columns and rows are then calculated 
m order. The values c; and c; check the formation of the columns 
and rows respectively. 

In calculating the element in row j and column k, the products 
of corresponding elements in row j and column た of the lower 
matrix are subtracted from , and divided by S; if j < k. Table 
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9.5.5.1 illustrates the computation for ap. The appropriate ele- 
ments can be selected by a pair of cards or a right-angled template 
placed as shown. After some practice the correct elements will 
be selected automatically. 

TABLE 9.5.5.1 
Selection of elements in the compact method. of single division 


gs = (M- S200 — S5,21)/8;; 


9.5.5.1 Example 
Table 9.5.5.2 shows the solution by the compact method of single division 
of the *normal' equations obtained in Example 9.5.4. 
TABLE 9.5.5.2 


Solution of ‘normal’ equations obtained by step function methods 
Factors removed: x, 102, g = 1: y, 10°, r = 2; 
elements divided by 10°, s = 2 


0-670000 0-201730 0-987264 1-465644 0.799000 4123638 

0 0-579910 0-549416 1-929256 一 0.239800 2818782 
— 0-210000 0-044480 0-516836 1:076610 —0-089200 1338726 

0 0-139290 0-414623 2-033754 —0-065000 2-522667 

0-460000 0-965410 2-468139 6-505264 

0-670000 | 1 0-301090 1-473528 2-187528 1-192537 . 6-154684 

0 0・579910|1 0-947416 3-326820 —0-413512 4860723 
— 0-210000 0-107709 0-724232 | 1 1-626084 4-0-284124 . 2-910208 

0 0-139290 0-282657 1:110737|1 — 0-078967 0-921034 

0-460000 0-826909 1-006889 1-110737 

0-920486 — 0-541641 0-412531 — 0-078967 

1:920489 0-458356 1-412529 0-921034 


The fitted curve is 
ua = 92-049 一 5.41642 + 0-412532? —0-00789672?. 


9.5.6 Efficiencies for non-uniform spacing 

The step functions are intended for cases where the spacing is 
non-uniform, but the steps were in fact chosen to give maximum 
efficiency for uniform spacing. When the spacing is non-uniform 
the efficiencies are usually lower. The standard deviations can 
be evaluated by replacing CI by ZW X*, where X is the 
smoothed variable of (8.5.1,2a) specified by the two parameters 
cs and xg. The efficiencies can then be obtained in terms of these 
two parameters. Table 9.5.6 shows the efficiencies for baz and 5。。. 
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TABLE 9.5.6 
Efficiencies of the coefficients bpp 


The effect of departures from uniform spacing is summarized 
in Table 9.5.6.1. Since the efficiency of the fitted value is at 
worst only slightly less than the efficiency of b,,, this table will 
also give the limiting efficiencies for the fitted values. 

The loss in efficiency will not usually be important for first- 
and second-degree polynomials, but it may be serious for poly- 
nomials of the third degree. However, the efficiency may be too 
severe a criterion for judging the value of grouping methods. 
Perhaps & more suitable criterion would be the increase in range 
of the observations necessary to offset the drop in efficiency. 
Caleulations based on Table 9.5.6.1 show that a 10% increase 
in range is required when the departure from uniformity is pro- 
nounced. It is clear that it might often be more convenient 
to take a few extra readings and use the simpler method of 
ealeulation employing step functions than to perform the full 
least-squares computation for the original observations. 

For the example of §§ 9.5.4 and 9.5.5.1, the efficiency of the 
estimate b4, can be shown to be 0-724. This is in agreement with 
the value 0-768 given in Table 9.5.6 for the case x2 = 0-25, ks = 0-5. 


TABLE 9.5.6.1 
Effect of departures from uniform spacing 


Departure from uniformity Efficiency 
1 b 22 bas 
Slight | Ke |, | ks | < 0:25 > 0:875 > 0-875 > 0-870 
Moderate | Ke |, | Ks |< 0-50 > 0-850 > 0-840 > 0-720 
Pronounced | kg |, | Kg |< 0°75 > 0-800 > 0-750 > 0-520 


9.6 GENERAL SUMMARY FOR THE 
UNEQUALLY-SPACED CASE 


Table 9.6 gives the times required to fit polynomials of the first, 
second, and third degrees to the example used in this chapter. 
The efficiencies and the estimates a, = b,, are also given. It will 
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be seen that for the first-degree curve the step function method 
is by far the most rapid. For the second-degree curve the step 
function and least-squares grouped methods require about the 
same time, while for the third-degree curve the least-squares 
grouped method is the most rapid. 


TABLE 9.6 
Comparison of different methods of calculating the polynomials 


First degree Second degree Third degree 


as ( x 103) 


Least-squares 
Least-squares grouped 
Single-step functions 
Double-step functions 


4-18 


10 14% 10 to 
の の Gi の 


Each method has its advantages and disadvantages, and each 
will be useful in some examples and not in others. It is probably 
true to say that the least-squares grouped method is the most 
satisfactory in cases where it can be used. For the bias to be 
small with this method the second- and third-degree coefficients 
must not be very large. When these coefficients are large, cases 
may arise in which it is convenient to remove the greater part of 
their contribution to y; by subtracting bf bg from y; before 
grouping, b, and b, being approximate values of the coefficients. 


9.7 NOTES AND REFERENCES 


(9.1) The least-squares grouping method was discussed in & paper by 
Guest (1954). 
(9.4) This treatment is based on & paper by Guest (1956). 
(9.5) A less efficient method of grouping is described by Nair and 
Shrivastava (1942). 
9.5 TABLES 


TABLE 9.8a 
Formulae connecting the coefficients a, and A 


Asn = 779 sy 

Qan = T7 Lan 

Csn = T7 ax TAX — 1 AN} 

aan = r7 (a +3(1 — 779) Sax) 

ayy ニテ ay 圭吾 ロー ケー) ay + rell — 772) (N* S- 672) Aey} 
Con = し Lon 
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TABLE 9.8b 
Values of yı and y, (9.1,6) 


?is 


2 8/81 80/189 
3 99/1000 297/700 
4 19/121 360/847 
5 143/1440 143/336 
6 84/845 72/169 
7 39/392 585/1372 
8 112/1125 32/75 


TABLE 9.8c 
Single-step functions for the equally-spaced case 


Single-step functions 


Zero degree boy = Y y/n First degree b,, = N [X Wie 
— ーー — 
Bos Bos W, ÈW e Bis Bs 

—4 10-56 と 3 一 1 10 一 了 26-6666667 

— 5-25 21-8352273 ジ ま 一 1 15 一 8.25 46-5625 

— 6-6r 32-3478261 X4—X£l 18 —11 86-6666667 

ー 8:25 56-0782895 25 — 22 21 — 14-25 152-0625 
—10 56-4324324 25 — 21 28 — 16 171-578947 
—11-916r 92-4430970 26 — 22 32 —19-75 277-198864 
一 14 118-484211 こ 6 一 2 36 — 24 400-307692 
— 16-25 178-9125 27 — 22 45 — 26:25 555・757415 
—18:6r 259-2 7 一 2 50 —31 761-176471 
— 21-25 363-085227 E8—r3 55 — 36-25 1054-98355 
—24 440-228571 28 — 22 66 — 39 1200-25 
— 26-916r 591・596398 29 — 23 72 — 44:75 1550-67361 
—30 596-689655 29 — 3 78 — 51 2053-08475 
— 33-25 700-141810 210 — X3 91 — 54:25 2471-49761 
— 36-6r 915-2 210 — £3 98 — 61 2677-97849 
— 40-25 1174-97540 —11— 24 105 — 68:25 3303-74133 
— 44 1485 X11— x3 120 ー 72 4017-72973 
— 4'I-916r 1699-51705 212 — 24 128 一 79.75 4867-71991 
— 52 2103-90448 212 — 84 136 — 88 5462 
— 56-25 2575-15754 X13— X4 153 — 92:25 6518-0625 
ー 60・6r 2593-69038 £13 — £4 162 —101 7717-36937 
— 65:25 2902-9725 X14— X5 171 —110:25 9321-53708 
一 70 3505-46341 Xl4— X4 190 —115 10591-5486 
—74-916r 4194-79821 215 — 5 200 — 124,75 12598-6870 
— 80 4653-87611 215 — 25 210 —135 13542-5806 
ー 85.25 5500-39123 216 — 25 231 — 140.25 15553-9937 
— 90-6r 6455-21590 216 — 5 242 —151 17882-4828 
— 96:25 7105-3125 Zz17— 26 953 — 162-25 20818-9764 


—102 7099-2 217 — X5 276  —168 23577 
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Single-step functions 


Zero degree boy = Y y/n First degree 511 > W, 22 We 
+ = = 
Bo» Bos W, > W, e Pis Bis 

— 107-916r 8260-38603 > 288 9-7: 24189-5306 
—114 9554-95385 218 — 2 300 2 27885-1777 
ー 120-25 10396-6582 325 98-25 28898-9048 
ー 126-6r 11927-1610 338 : 33115-0057 
— 133-25 13617-3606 >: > 351 224-2: 37136-3294 
— 140 14739-4967 2 378 2 41372-4706 
— 146-916r 14734-2725 X 392 244-7: 46135-2764 
— 154 16722-8852 < 406 25 52035-7419 
— 161-25 18901-3609 2:2 435 266-2: 57467-5970 
一 168.6r 20294-6356 23 š 60364-875 
—176-25 22803-7383 3 > 296-2 67631-1107 
— 184 25533-8680 223 — = 73189-0720 
一 191.916r 28497-1290 24—Y 3 ・7: 81530-2345 
— 200 30428-0980 24 — >> 52 89405-952 
— 208-25 30449-5231 25 44-5 93132-9528 
— 216-6r 33843-3333 2: 96082-0856 
— 225-25 37506-4392 2 > 595 78.25 104845:616 
— 234 39823-0675 26 — 2 114079 ·560 
— 242.916 43950-4346 2 . 124075-662 
— 252 48384 2 > 4 136438-061 
— 261-25 51235-5313 2 > 2-2t 145780-973 
一 270.6r 51270-2815 2 25 159660 

— 280-25 56263-6052 22 > "2i 167854-312 
— 290 61604-3855 2 7 178698-824 
—299-916r 64951-5129 = > -7i 194952-761 
— 310 70886-1768 230 — 510 : > 209861-796 
— 320-25 77210-0490 x31—210 530-25 225148-283 
— 330-6r 81235-9534 531—510 £ 241793-301 
— 341-25 88224-3429 x32—XYX11 572-25 | 252899-062 
—352 88318-3304 232—510 267774-222 
—362-916r 95783-6593 233— 11 75 274119-002 
— 374 100428-859 xX33— X11 ç = 296485-181 
— 385-25 108633-631 £34— Ell 2 313032982 
— 396-61 117320-565 234 — X11 i 337636-5S3 
— 408-25 122805-531 235 — 212 "2 360013-223 
—420 132310-504 E35— X11 2 370623-083 
—431-916r 132437-083 236 — £12 5: 75 394725:353 
— 444 142526-586 E36— 512 423895-004 
— 456-25 148768-310 E37— 312 756-25  445713-600 


— 468-6r 159758-753 237 — 212 1250 477551-503 
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TABLE 9.8c (cont.) 


Single-step functions 


522 = > Way ZW e 
+ + 


Second degree 


n W, > W, e Beg 

7 3(23— 22) 一 221 50 —9-64 

8 2084 — X3) 一 22 44 — 13-40909091 
9 3(24— E3) 一 281 92 — 16-65217391 
10 20286 — Ta) 一 22 76 — 21-44736842 
11 5(25 一 23) 一 422 370 一 23.44324324 
19 3(26 一 24) 一 2D 268 一 29.00746269 
13 5(Z6 一 24) 一 452 570 一 33.46315789 
14 3(27 一 Z5) 一 223 400 一 40.06 

15 7"(Z1—X5) 一 423 1078 —47-28571429 
16 2( ら 8 一 6) 一 24 352 — 55-13636364 
17 (8-26) = cee 1470 — 61-34285714 
18 2029 — 27) 一 24 472 — 70-22881356 
19 3(29 一 26) 一 284 1044 一 73.68965517 
20 4(S10 一 7) 一 384 1624 — 80-70689655 
21 3(210— 27) 一 224 1350 — 90-76 
22 5(ZI11 一 Z8) 一 385 2480 — 101-4419355 
23 11(£11— Z8) 一 625 5984 —112-75 
24 5(212— 29) 一 3X5 3080 — 121-5181818 
25 11(Z12— £9) 一 6X5 7370 —133:8597015 
26 (513-510) — X6 1452 — 146-8305785 
27 13(813— 59) — 8X6 12428 — 151-7531381 
28 3(214— 210) 一 2X6 3200 — 161-74 
29 13(214— 210) — 8X6 14924 — 175-8780488 
30 7(X15—Z11) — 457 8624 — 190-6428571 
31 13(£15— £11) 一 8826 17628 — 201-9734513 
32 7(£16— £12) 一 437 10136 — 217-7707182 
33 15(E16— 812) 一 8X7 23140 — 234-1972342 
34 7(Z17—X13) 一 437 11760 ー 246-8714286 
35 3(217 一 213) — 257 6250 一 253 
36 8(£18— £13) 一 5S8 17680 一 270:5941176 
37 17(Z18 一 Z13) 一 1028 39780 一 288.8153846 
38 8(Z19 一 Zl4) 一 5X8 20240 — 802-7086957 
39 17(I19—€14) 一 1028 45390 — 321-9617978 
40 90820 — Is) 一 5X9 25320 — 341-8440758 
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TABLE 9.8c (cont.) 


Single-step functions 


Second degree b. = >W, v/> W es 
ES F 
W, > W, e° 824 
2 
17(20— 815) 一 1028 51340 — 357.0821192 
42 3(E21— 215) 一 2x9 10800 — 364-54 

43 19(221— £15) — 1289 71858 — 385-5901639 
44 5(222~—216) — 3510 19840 — 407-2677419 
45 19(222— 216) 一 1229 80522 — 423-7239264 


5(£23— 517) 一 3510 22180 — 446-4329125 
7(223— 217) 一 4S10 32466 — 469-7710220 
11(E24— X18) 一 68811 53284 — 493-7369942 
7(£24— X18) 一 4510 35994 — 511-9404901 
11(Z25— £18) 一 7811 65604 — 520-8661972 


23(225— X18) 142968 — 546 


12(226— £19) 一 78212 77672 — 571-7602740 
28(226— 219) — 14211 157458 ー 591-1840491 
12(227— 220) 一 7212 85400 — 617-9780328 
25(£27— £20) — 14212 184800 — 645-4 


12(228 — 221) 93464 — 666-1668664 
25(£28— 220) 一 16212 221400 ー 676-4222222 
13(829 — 2521) 一 8213 119392 ー 705-0121951 
27(229— 221) — 16213 256968 ー 734-2289157 
13(£30— 222) 一 8513 130000 — 756-2152 


27(230— 822) 279432 — 186-4650863 


7(31— 223) 一 4214 74928 — 817-3430493 
27(831— 223) 一 16513 302760 — 840-6732461 
7(32— 234) 一 4214 81088 ー 872-5828729 
29(232— £23) — 18514 376188 ー 884-3043478 


5(£33 — 824) 66960 — 916-9774194 
29(£33— X24) 一 18814 405942 — 941-5263609 


5(E34— 225) — 3215 72180 — 975-2321696 
31(234— 225) — 18215 461280 ー 1009-566129 


5(235— £26) 一 3515 77580 — 1035-459629 


316835 — 226) — 18215 495318 — 1070-825009 
8236 — 226) 一 5X16 141440 — 1083-876471 


3336 — 226) 一 208216 600490 — 1120-005825 
8237 — £27) 一 5216 151520 — 1147-117529 


33(£37— £27) — 20516 642730 — 1184-279274 
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Third degree 


x3 

9X4 

3X4 
5(=5— X4) 


6(Z5— X4) 
15(X6— X5) 
5(Z6— X5) 
24(27— X6) 
15(27 — 26) 


7(£8— £7) 
7(Z8— £7) 
35(X9— X8) 
20089 — X8) 
48(X10— X9) 


27(X10— X8) 
63(811— X9) 
5(Z11— X9) 
20(£12— £10) 
35(X12— £10) 


77(F13— X11) 
44(Z13— X11) 
24(X14— X12) 

2(£14— X12) 
117(Z15— X13) 


54(Z15— X13) 
39(516— X14) 
65(16— X14) 
35(Z17— X15) 
25(Z17— X15) 


5(Z18— E15) 
88(Z18— X15) 
11(Z19— £16) 
44(Z19— 16) 
64(Z20— X17) 


TABLE 9.8c (cont.) 


Single-step functions 


222 
1683 
5x3 


3(Z4— X1) 


553 
11(24—21) 
3X4 
13(Z5— £1) 
7X5 


3(86— X1) 
4(Z5— X1) 
17(Z6— X1) 
9(X6— X1) 
19(£7 — X1) 


19(£7 - X1) 
40(Z8— X1) 
3(E8— X1) 

11(9— X1) 
23(58— 21) 


48(X9— X2) 
25089 — X1) 
13(310— £2) 
(Z10— Z1) 
56(£11— £2) 


29(Z10— X1) 
20(Z11— X2) 
31(Z11— £1) 
16(Z12— x2) 
11(Z12— Z2) 


3(E13— Z2) 
51(Z13— X2) 
7(313— X2) 

27(Z13— X2) 
37(Z14— X9) 


bza = TTM. e 


TN. è 


36 
504 
240 
540 


1140 
3630 
1560 
9204 
7140 


3990 
5376 
32130 
21240 
59736 


63612 
172620 
15540 
71280 
154560 


378840 
244200 
147264 

13716 
881244 


485460 
, 882590 
701220 
409920 
316800 


93060 
1,768272 
256410 
1,102464 
1,736928 


Bss 


— 11-66666667 
— 15-83333333 
—21 

— 27-16666667 


— 30-47368421 
— 37-77272727 
— 44-84615385 
— 53-51694915 
— 61-94117647 


ー 71-97368421 
— 78:75 


— 100-8644068 
— 112-1946565 


— 117-6881720 
— 129-7846715 
— 144-1351351 
— 157-5740741 
— 167-25 


— 183-7195122 
— 198-7297297 
— 216-5677966 
— 232.9265092 
— 252-1282528 


— 262-2043011 
ー 282-5244648 
— 301-4137931 
— 323-1065574 
— 345-7916667 


— 352-4432624 
— 375-9644670 
— 388-0855856 
— 412-7298851 
— 435-3016360 


Third degree 


34(X20— X17) 
17(X21— X18) 
39(£21 — X18) 
247(X22— X19) 
13(822— £19) 


247(523 — X20) 
133(£23 — X20) 
56(X24— 21) 
50(£24— X21) 
280(525— £22) 


147(E25— X21) 
105(526 — X22) 
1650826 — X22) 
44(x27— 523) 
92(x27— £23) 


391(X28— X24) 
102(E28 — X24) 

16(=29 — X25) 
102(X29— 525) 
425(X30— 226) 


75(X30— X326) 
117(E31— €27) 
247(X31— E27) 
39(£32 — X28) 


247(832— X28) 


513(£33 — X28) 
266(X33 — £28) 
16(E34— X29) 
29(X34— X29) 
609(X35 — X30) 


58(£35 — £30) 
609(F36— £31) 
63(£36— 231) 
44(Z37— 232) 
341(£37 — £32) 


Wz 
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TABLE 9.8c (cont.) 


Single-step functions 


19(514—=2 
9(X15— X2 
20(E15— X2 
123(£16 — £3) 


7815 — 22 


1296816 — X3) 
6606816 — £2 

27(817— £3) 
23(817— £2) 


141(X17— X3) 


94(Z17— £3) 
64(X18— £3) 
98(X18— X3) 
250819 — 83) 
51019 — X3) 


208(X20— X3) 
53( エ 20 一 3) 
9(x20— X4) 
55(X20— X3) 
224(X21— X4) 


38(Z21— E3) 
58822 — X4) 
118(Z22— X3) 
20( マ 2 ヌー X4) 


305(X23— £4) 
1556823 X4) 
90 824 E4) 
166824 — X4) 
3250825 — X4) 


330824 — X4) 
335(X25— X4) 
340825 — X4) 
23(226 — X4) 
1750226 — X4) 
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bao LN He ë 


EM, e 


988380 
533052 
1,305720 
8,810490 
524160 


10,971492 
8,336160 
13,809180 
3,907200 
8,595744 


38,671464 
10,595760 

1,814400 
12,207360 
53,264400 


9,900900 
16,150680 
35,849580 

6,121440 
40,680900 


103,892760 
56,155260 
3,540600 
6,681600 
146,860350 


15,024900 
164,844120 
17,714340 
12,910590 
103,834500 


Pas 


— 461-3137255 
— 485-2363184 
— 512-6129032 
— 540-9827586 
— 555-5416667 


— 585-0301205 
ー 611:8587896 
— 642-7178952 
— 670-8986667 
— 690-6405672 


ー 703-9420655 
ー 733-0989520 
— 766-9110070 
— 797-4189189 
— 832-5982533 


— 864-4558360 
— 901 

— 924-1666667 
— 957-5808824 
— 996-2372654 


— 1031-003454 
— 1071-029412 
— 1107-146341 
— 1132-597859 
— 1 169-888889 


— 1186-813253 
— 1229-792952 
— 1268-236655 
— 1312-583333 
— 1352-376011 


— 1380-515924 
— 1421-490099 
— 1468-321241 
— 1510-648148 
— 1558-848276 


os t2 LS t5 to 
cen ne 
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Fourth degree 


TABLE 9.8c (cont.) 


Single-step functions 


W, 
$($2$—- 一 5(Z2— Xl) 
(P4=259) < 2(£3— X2 
25084 — X3) 一 46023 — X2 
9085 — 84) = 10684 — X2 


7185 — 24) 一 
1626 — 25) 一 
72086 — €5) 一 
59(87— 26) 一 


144089 — 8) 一 
590(19— E8) 一 
206081089) 一 


415(810— 29) 一 
284(811— X10) 一 
2350211 — 210) 一 
415(812— 211) 一 
217(212— 211) 一 


160814 213) 一 
2989(814— 813) 一 
9440815 — 214) 一 


5350218 — 214) 一 
5860816 — £15) 一 
1533(E16— £15) 一 
763(817— 215) 一 
1491(Y17 一 Y15) 一 


2240(£18— £16) 一 
9420(818— E16) 一 

141(£19— 217) 一 
11148(819— £17) 一 
2820(£20— X18) — 


41(X6— X3) 
29(Z6— X3) 


11(£7 — £3) 
31(Z7— X3) 
71(=8— La) 
395(Z7 — 23) 
131(=8— X4) 


245(X8— La) 
161(Z9— £5) 


117(Z9— Z4) 
194(X10— Z5) 
98(=10— X5) 
115(EZ11— Z5) 
1155(Z11— £5) 
6(X12— X6) 
1344(X11— £5) 
410(Z12— £6) 


221(£12— £6) 
235(£13— £7) 
561(£13— £6) 
502(Z14— X7) 
957(X14— X7) 


十 十 十 十 十 “十 十 十 十 十 十 十 十 十 十 十 十 十 十 十 十 十 十 十 十 十 十 十 十 十 十 十 十 十 


= 
£16— E8) 


10623 


22622 
12053 
100x3 
185X3 

7853 


13453 
112653 
5x4 
145023 
37924 


22653 
2064 
53254 


` 49704 


82654 


107185 
540824 

7025 
579254 
169655 


ba = ZW y Mie. 
+ ー 


EW, à 
十 


168 
144 
5376 
3600 


39648 
12480 
84768 
90000 
89880 


54960 
200376 
613152 

4,138824 
1,721280 


4,182864 
3,345552 
3,395784 
7,072128 
4,241328 


6,855936 
80,879904 
489312 
125,116488 
44,279712 


28,384776 
34,551408 
103,700520 
97,162464 
209,629728 


346,514448 
1680,885360 
27,560016 
2408,213808 
763,126848 


Fourth degree 


13332(X20— X18) 
415(Z21— X19) 
15620(Z21— X19) 
4779(X22— 20) 
19074(X23— X20) 


5535( マ 23 — X21) 
21945( や 23 — X21) 
415(£24 — £22) 
8489(£24 — £22) 
3785(£25 — £23) 


30485(X25— 223) 
$680(X26— X24) 
34645(X26— 224) 
1967(X27 — X25) 
46255(X27— X25) 


1650(X28 — X26) 
10406(X28— 26) 
6713(X29— X27) 
3355(X29 — 526) 
844( 830 — 527) 


13897(=30— X27) 

4220(E31— X28) 
37553(X31— X28) 
19396(=32 — 529) 
86190(£32 — X29) 


10738(=33 — £30) 
95251(£33 — X30) 
26286(X34 — X31) 
1081710834 X31) 
7455(X35 — X32) 


118643 (835 — X32) 
14910(=36 — £33) 
131005(X36 — £33) 
32655(537 — X34) 
143241(X37 — X34) 


9.8 TABLES 323 


TABLE 9.8c (cont.) 


Single-step functions 


544 = = W, 72 W, <4 
= + 
W, TN. 


70085 3922.631856 

22655 133,851648 
745655 5452.591056 
227126 1855,459872 
935425 8071.065288 


8151(X16— XS) 

345(X17— X9) 
9031(X17— X9) 
3576(X18— X9) 
9955(X18— X9) 


240656 2521,801584 
989455 10844,513064 

185£6 2206,308096 
385056 5386,084704 
156056 2388,695712 


2884(X19— X10) 
10923(X19— X10) 
194(X20— X10) 
4667(X19— X10) 
1693(X21— X11) 


140806 22841.591136 
361087 6940.391392 
1480026 29764,941336 
75S と 7 1798,4080S0 
1775427 46002,560208 


15249(520— X10) 
4263(X21— X11) 
16549(X21— X11) 
924(X32— X12) 
20515( マ 2 ヌー X11) 


64957 
371857 
269087 
1722277 


39628 


713(523— £12) 
4427(X23— X12) 
2688(X24— X12) 
1915(X24— X12) 

475(X25— £13) 


7280 マ 7 28318,400448 
2241X8 9725,818032 
18306=8 91341,873936 
1046558 51074,547264 
4271858 239180,368752 


7407(X25— X12) 
2549(825— X13) 
22355(E25— X13) 
10916(X26 — X13) 
7821(826— X13) 


544758 31584,929376 
4443458 294717,067632 
1132329 85474,898496 
5133858 378953,415120 

826929 27413,402688 


5830(€27 — X14) 
51034(X27 — X14) 
13905(X38— X15) 
54349(538— X14) 
3699("=29 — X15) 


532708 4603 74.156648 

725239 65312,203824 
59066x9 601034,805504 
15029 と 9 157710,048048 
6116659 723517,105920 


57766(X29— X15) 

7857(S29 — X15) 
6S153(29 — X15) 
16659(X30— X16) 
72200(230— X16) 


十 十 十 十 十 “十 十 十 十 十 “十 十 十 十 十 “十 十 十 十 十 +++++ bbb b boob Rb 


to to LS t$ to 
QU i Q9 (Š — 
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Fifth degree 


(23 — 22) 
15( と 4 一 3) 

9(=4— E3) 
49(X5 — La) 


26(X5— La) 
72026 — X5) 
3(X6— X5) 
112(X7 — X6) 
275087 — X6) 


19688 — 57) 
481(Z8— 27) 
1755(X9 — £8) 
287(X9— E8) 
819(X10— X9) 


119(Z10— X9) 
697(X11— X10) 
1037(11 一 10) 
5586(£12— X11) 
510(F12—X11) 


228(F13— X12) 
1824(X13— X12) 
2528(X14— X13) 
3220(214— X13) 
35200(X15— X14) 


22149(Z15— X14) 
14553(X16— X15) 
29475(X16— X15) 
34125(X17 — X16) 
10465(X17— X16) 


3540(Z18— X17) 
1925(Z18— X17) 
36736(X19— X18) 
110374(Z19— X18) 
12111(Z20— X19) 


POLYNOMIALS AND OTHER CURVES 


TABLE 9.8c (cont.) 


Single-step functions 


W, 


4(£2— X1) 
49(=3— X2) 
26(£3— X3) 
111(Z4— £3) 


55(Z4— 23) 
143(Z5— X4) 

485 — £3) 
130086 — X4) 


1 
or Or Or Sr 
一 一 一 一 一 


MMMM 
© の の -3 -1 
| 
L4 t4 t4 t4 t4 


o 


| 


75089 — X6) 
455(£10— £7) 
583(£10— X6) 

3059(Z11— X7) 
430(10— £7) 


115(X12— X8) 
1274(Xll— X7) 
1701(X12— X8) 
2030(X12— X8) 
21518(X13— X9) 


13230(X13— X9) 
8463(X14— X10) 
16344(X14— X10) 
16632(X15 — X10) 
4998(Z15— X10) 


1652(£16 — X11) 
861(£16— £11) 
14874(Z17 — £11) 
43890(Z17— X11) 
4719(218— X12) 


4- 
+ 
+ 
+ 
T 
+ 
+ 
小 
十 
十 
十 
十 
十 
十 
十 
十 
十 
+ 
中 
十 
+ 
st 
+ 
+ 
小 
十 
十 
十 
十 
十 
十 
+ 
+ 
+ 


143(X3— X1) 
23153 


13(X4— X1) 
364X3 
1547(X4— X1) 
18954 
456(X5— X1) 


100(£6 — X1) 
1235(X6— X1) 
1413(X7 — X1) 
2009(X6— X1) 
18183(57 — X1) 


10235(X7 — X1) 
5735(X8— X1) 
12800(37 — X1) 
15125(X8— X1) 
4199(58— X1) 


1239(Z9 — X1) 
732(E8— X1) 
14245(X9— X1) 
39121(X9— X1) 
3809(Z10— X1) 


2,808960 


252720 
8,910720 
47,895120 
9,954000 
35,112000 


6,283200 
47,295360 
95,729040 

615,593160 
92,085120 


37,044000 
485,503200 
788,492880 

1202,742240 
15207,265920 


10916,650080 
8211,661920 
19440,662400 
27440,028000 
9460,956960 


3608,463600 
2257,995600 
51234,261120 
171065,664000 
20909,168280 
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TABLE 9.8c (cont.) 
Single-step functions 
Fifth degree b= >, 72 W; e 

n W; EN, 

41 69223620 219) 一 259606818 — £12) + 23405(X9— X1) 135787,454880 
42 5241606821 — X20) — 2417360818 — X12) +  229395(X10— X2 1,379383,716480 
43 17949(E21— £20) 一 8085(E18— E12) + 6944(X10— El) 52229,469600 
44 1895406222 — 221) 一 83850819 — X13) + 67946811 — X2 60473, 424960 
45 60750822 — $3231) 一 25680819 — X13) + 22336810 — X1) 21840. 477120 
46 1040916823 — X33) 一 432900820 — X14) + 33448(0811— X2) 408320. 138080 
47 80600823 — X22) 一 32890820 — X14) + 2461(X11— X1) 34633.959360 | 
48 128(X24— X23) 一 47(E21— XM) + 47(X11— X2) 639.576000 
49 73437(324— 223) 一 26468(X21— X14) + 24192(X11— £1) 400419,714240 
50 34595( や 25 一 や 24) 一  12385(E22— X15) +  10619(X12— 82) 204535,553040 
51 9709(£25 — £24) 一 3400(x32— X15) + 3793(€X12 — 22 62103,392400 
53 57967(326— £24) 一 36800(>23— X16) + 30355(X12— £2 696524,337600 
53 13650(Z26— 224) 一 8075(£23— £15) + 7014(X12— £2 185253,868800 
54 289960(£27 — 525) 一 168883(224 — X16) + 44768(X13 — X2 4,267843,.419840 
55 411312(£27— £25) — 236698(824 — X16) + 19859 :(213 — ES} 6,521985,180480 
56 380380(528—526) 一 212355(525—217) +  183456(X13— 2) 6,654265,778160 
57 44032(528— £26) 一 24310(225— X17) — 199950813 — X2) 827440922880 
58 236844 (829 — 227) 一 122752(826— X17) + 10926306814 — 22 4.995904.858560 
59 216376(>29 — =z d — 136629(£25— E17) +  109478(X14— £2) 5,466377,064000 
60 35200(£30 — 228) 一 215I18(£26 — X18) + 18183(X14 — X2) 9732065,018880 
61 1266840(230 — £28) 一 7652890826 — X18) +  617730(X14— X2) 37,441514,658240 
62 2917642(£231— X29) 一 1738165(X27— X19) + 1310080(X15— X2 92.410608,850560 
63 14701606831 — X29) 一 8334510827 — E19) + 6938140814 — X2 30,516195, 501280 
64 71358690832 — X30) 一 387081506828 — £19) + 34050096815 — ジコ 271.871714.130120 
65 2435960232 — 230) 一 131950828 - X19) + 111166815 — £2 997715,759040 
66 1297863(233— X31) 一 6873606829 — 20) + 34364806816 — X2) 56,181483,308160 
67 117450833 231) 一 607106829 — 20) + 31506815 — X2) 549091.623600 
68 101657790834 — X32) 一 5203055(C30 - X21) + 42361110816 — X3) 504,334672,086960 
69 108205(x34—€32) 一 5219306830 — x20) + 4356006216 — X2) 5,908029,356880 
70 10465(X36 — X33) 一 4998(231— £21) 十 4199(X17 — E3) 605501,245440 
71 1727005(£35— 233) 一 804517(831— X21) +  707020(X16— X2) 107,839889,483760 
72 5445(X36— E34) 一 2513(:232— X22) + 2124(X17 — X3) 359665,639200 
73 4477275(536 —€X34) 一 1961375(€332— £21) + 1764279(X17— X2) 323,451443,343600 
74 123375(=37— 235) 一 63308(532— 22) + 52128(X18— =) 10,241611,002000 
75 5066600(537— X35) 一 214802506833 — 222) + 194486606817 — £2 415,718898,302400 


7900 960·0 0 Sc0-0— 990-0 Lc0-0 0 S60:0— 690-0 620-0 Lc0-0— IS0:0— 
L10-0— 900-0— 0 00-0 g10'0 一 900.0 一 0 <00:0 0 0 0 0 
8SIT-0 660-0 2940-0 vS0-0 8800 690-0 £200 980-0 0 0 0 
790-0 7800 0 180•0 — *L0-0 S€0:0 0 $£0:0— 980-0 0$0:0 9$0-0— $990-0— 


L6L-0 1910 OZt:O ZOL-0 6L1-0 9cL-0 960-0 640-0 £*L-0 IOI:O 40:0 490-0 990-0 
991-0 O€T-0 660-0 à LII:O I60-0 690-0 [20-0 0 


0-t 0 9•0 一 oL 
9:0 
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9.8 
TABLE 


TABLES 
9.8e 


Step functions for the unequally-spaced case 


First degree 
23＋27— 210 


E4--€X7— E11 
=4+=8— 212 
=4+29—213 
25 ＋ 29 — 14 
25 ＋ 210 — 21s 


X5--€11— X16 
26+ 211-217 
26+ 212—Z18 
26 ＋ 213 — 219 
27 ＋ 213 - 220 


27+ 214 221 
27 + 215 — 222 
28 ＋ 215 — 223 
E8--€X16— X24 
28+ 217—=25 


29 + 217 226 
29+ 218 — 227 
29 ＋ 219 — 228 
ジ 10 十 19 一 29 
F10+ X20— £30 


210+ £21 — E31 
£11 -+821 — £32 
£11 + £22— £33 
211+ 223—234 
12+ 223 — 235 


X12--E24— X36 
812825 — X37 
813＋825— 838 
813 ＋7826— X39 
E13--E27— X40 


Xl4--E27— X41 
X14--X28— X42 
X14-- X29— X43 
X15--X29— Y44 
X15--X30— X45 


X15-- X31— X46 
X16--€331— X47 
216 ＋ 2832 — X48 
216+ 333— 49 
217+ 533 50 


£17+ 34— X51 
217+ 235 — 252 
F18+ 235—253 
X18-- 236 — X54 
218+ 2537—=55 


Second degree 
E14-X2— X8— X9--YX10 


XE1-4X3— X8— X10--Y11 
2I＋ 3 — 89 — 211212 
21+ 23 — 10-212 513 
22+ 283 — 11 — T1214 
224+ 24—511—213+ 515 


22+ 24—D12—2U14+2E16 
E2--X4— X13— X15-- X17 
E2-rFX4—X14— X16-- X18 
X2--£5—€14--€17--X19 
22 ＋ 25-215 — 218 ＋ 20 


22 ＋ 25 — 216 — 219 ＋] 221 
22+ 25 — €17— 220 ＋ X22 
2 ＋ 26 — 217 — 221 + 223 
23 ＋ 26 — 218 - 2212224 
23 + 26 — 219 — 222 ＋ 25 


23 ＋ 26 — 220 — 223 + 226 
23 ＋ 27 — 220 — 224 ＋ 227 
€X3--37—€21— 225 ＋ 28 
3 ＋ 7-222 — 226 ＋ 829 
3 + 27 — 223 — 227 + 30 


E3 + 28 — 223 — 228 X31 
£3 + 28 — 224 — £29 + £32 
LA E8— X25— 29 ＋ X33 
F4+ 58 X26— 530+ 334 
T4＋ 29 — 226 — 317235 


F4+ 9 227 — 327 X36 
X4--Y9— £28 — 233 + 37 
24 ＋ 89 2829 — 534+ 538 
E4--X10— 229 — 235+ 39 
Ta ＋ 1-230 - 536+ X40 


X4--X10— £31 — E37 + Y41 
25-+210— £32— X37 + £42 
XE5--X11— £32— £38 + X43 
X5--€X11— 533—539 ＋ Y44 
X5--X11—X34— 240+ X45 


E5+511— E35— E4] + X46 
忆 5 十 二 12 一 二 35 一 工 42 十 二 47 
XE5--Y12— X36— 243+ X48 
X5-.-€X12— X37 — X44 2- X49 
55+ 212—38—=45+ 550 


6 ＋ 212 — 839 — 45 ＋ 551 
6 ＋ 213 - 239 — Y46--Y52 
26 ＋ 513 240 — X47 4- 353 
26 ＋ 213 — X41— Y48-- X54 
26 ＋ 213 42 — 49 555 


Third degree 


221 + 22 — 4 — 6 ＋ 28 ＋229— 2210 


12282 — X5— X6-- X9--2X10—2X11 
4 €X2— X5-— Y7--Y10--2X11—2€12 
+ 2 6 — 27+ E11 +2E12—2213 
22 — X6— X8--€X12--2X13—2X14 
22 — 27 — X84-€13--2X14—2X15 


ZN 
t4 


+44 


NIN IN I 
1414121 


21+ X2— X7— X9+-F£14+2515—2516 
2X]--YX3— 7— X10-- X14--2€X16 —2X17 
2251+ 53—X8— X10-- €15--2€£17—2Z€18 
231-4-X3— X8— L11216 ＋2218— 2219 
2X14€X3— X39—X11-€17--2X19—2x20 


221+ 53 — 89 — Y12-- X18--2320— 2821 
222 ＋ 53 — XY10— £12+ 19 +2=20—2=E22 
222+ 53 — X10— 513+ X20-2-2321— 2223 
222+ 24—211 — 513- X20--2322— 2224 
2X24-X34— 311— X14-- 214-2223 —2=25 


232--£X4—111—2X15-- YX22--2324—22126 
222+ 24 — X312— X15-- 223 ＋2225 - 2227 
222 ＋ N- X12— X16-2- X24--2326 2228 
2224+ - 213 - 516+ 525 +2227—2=2 

222 + 55 — 213 —- 17 ＋ £25 +2228 —2230 


2X2-4-X5— X14— X17--€26--2329 — 2831 
222 ＋ 25 — X14— 218 ＋ X27-4-23330— 23:32 
2X2--X5— X15— X18-- X284-2331— 28233 
272 ＋ 25 — 1s — 219 ＋ 229 ＋T2232— 2834 
252+ 25 - €315— 20 ＋ 30 ＋2233 - 2235 


223 + £5— 316 — 220 ＋ X31--22:33— 2836 
223 ＋ 26 — 316— £21 -+ 3172834 — 2837 
253+ S6— X17— E21 + 3272235 — 2838 
223 + 86 — 217 — 822 ＋ 33 ＋ 2236 — 2839 
253 + X6— X18— 222 ＋ 23472237 — 240 


253+ X6— 218 - 223 + Y35--2338 2841 
223 ＋ 286 — 219 — 823 + 23642239 — 242 
253 + X6— X19 — 224 372840 — 23:43 
253 + X7— X19 — 3:25 ＋ X37 -- 2X:41 — 244 
223 -+ £7 — X20— 225. 238 2242 245 


223 ＋ 57 X20— 26 ＋ 239 + 2543 246 
223 ＋ 37 — X21 — 226+ 540+ 2844 — 247 
253 + £7 — £21 — £27 + X41--2X45 - 2848 
253 + X7— X22— X27 + X42 -- 23246 2849 
2X4-- X8— X22— 528+ X42--2X46 2250 


254+ £8 — X22— 529+ X43 + 2847 — 2851 
254+ 58 — 223 — X29--Y44--2348— 2852 
254+ 28 — 223 — 30 ＋ 45 ＋ 2249 — 2853 
254+ 28 - 224 — 530+ 546+ 2250 2254 
254+ 58 — 24 — 31247 ＋T2251— 28255 


100 


First degree 


Z19--237— X56 


219-- 238 — 257 
219 ＋ 839 — 258 
220 ＋ 239 — 259 
=20+ 40 - £60 


220--X41 — 361 
E21--X41— £62 
=21+242— 363 
=21 + 243 — X64 
222 ＋ 43 — X65 


222 ＋ C44 166 
222 ＋ X45 — 367 
223 + £45 — X68 
2234-X46— 269 
223--2£47— 3770 


224 ＋ 847 — 271 
224 ＋ 48 — 272 
224 ＋ 249 — 273 
2:25-- X49 — 274 
225 ＋ 50 — 275 


225 ＋ 251 — 276 
226 ＋ 51 — 377 
226 ＋ 52 378 
226 ＋ 253 — 279 
227 ＋ 253 280 


227 ＋ 54 — X81 
227 ＋ 255 — 282 
228 ＋ 255 — 283 
228 + E56 — 284 
228 ＋ 257 X85 


229 ＋ 257 — 286 
2229 + £58 — 287 
3129 + 3:59 — 3:88 
30 ＋ 259 - 289 
30 ＋ 260 — 290 


530+ X61— X91 
531+ 61 — 292 
231 + 62 — 293 
231 ＋ X63 — >94 
232+ 263 — 295 


232 ＋7 364 — 3:96 
232+ 265—297 
233 ＋ £665 — 398 
233+ 266 — 2399 


TABLE 9.8e 


Second degree 


26+ 214—242— 250+ 256 


26 ＋ 214— 243 ~— 251+ £57 
26+ 214—244—552+ 558 
26 ＋ 214—245—253+ 59 
26 ＋ 215 — 45 C54 ＋ 60 


27+ 15 - X46— 54 ＋ X61 
27+ 215-247 255 ＋ 62 
27 ＋ 2815 — 248 — T56＋ 363 
27 ＋ 16-48 —£57+ 264 
27 --€X16— X49 — 3,58 ＋ 3:65 


=7+216—X50—259+ 366 
=7+216—251— X60-- 267 
X7-rFX17—X51— Z£61-- X68 
37--317—2:52— 262+ 3269 
x8 + 217— 253 — 262+ 270 


28 ＋ 817 254 — 363 - 371 
8 + Ls - 254 264+ 272 
28 ＋ 218 - 255 265+ 273 
8 + 218 56 - 266 ＋ 74 
8 + 1s — 257 267 ＋ 275 


28 219 — 257 268 + 276 
28 ＋ 819 — 258 - 269+ 277 
28 + 219 — 259 — 270+ 278 
29 219 — CO- L70279 
29 ＋ 20 - 260 — 271+ 280 


29 ＋ 220 — 61 — 272 ＋ 281 
29 + 220 — 262 — 73 + 282 
D 220 — 263 — 274+ 83 
29 ＋ 221 — 363 — 275+ 284 
29 221 — 64 — 276 ＋ 285 


29+ 2521 ~ 265 - 277 ＋ 286 
o ＋ 221 66 — 2878 ＋ 887 
210+ 222 66 — 378 ＋ 2:88 
210 ＋ 22 — 267 —2X79+ 289 
210 ＋ Z22— X68 280 -+ 290 


210+ 22 — 3:69 — X81 4- 291 
210+ 223 — 3:69 — 382-392 
X104-Z23— £70— £83 + 293 
210+ 23— £71 84 ＋ £94 
210+ 223 — 272 — 285 ＋ 295 


10 ＋ 24 272 286+ 296 
210 ＋ 2824 — 273 — 2874-297 
3114-3224 — 2274 — X87 4- 3:98 
E114-224— 2775 — X88 4- 2:99 


533 + 267— 2100 |Z11-- 225 — 275 — 289 ＋ 2100 


POLYNOMIALS AND OTHER CURVES 


(cont.) 


Third degree 


224 ＋ 8 225 — X31-4-Y48--223:52— 2256 
224 ＋ X9— 225 — 327 C48 ＋ 2253 2257 
224+ 29 226 — 232+ 249 ＋ 22542258 
224+ 29 - 226 — 233 ＋ 50 ＋ 2255 — 2259 
224+ 29 — 226 — 34 ＋ 5172256 —- 2260 


224+ 9 227 — 234+ 252722572261 
24 . - 27— 35 ＋ 53 +2258 —2562 
224+ 10 228 — 235 ＋ 253 ＋2859 — 22:63 
224+ 10-228 —236--2154--23:60—2X64 
225 ＋7 210 229 — 236 ＋ 255 ＋ 22:60 — 22:65 


225 ＋ 810 Z29 — 3:37 - 3556 -- 22261 — 22:66 
225+ 210—230— 237+ 257 +2262—2567 
225+ 210 230 - 238+ 258 +2263 —2£68 
225+ 10 230 239+ 23:59 -- 23:64 — 22:69 
225+8211— 231-239 ＋ 3:59 -22265 — 23770 


235--X11— 231 2:40-- 3260 4- 22266 — 2371 
225+ 211—232—240+ 261 +2267—2572 
23:5.-E11— 232 — X41 4- 262-2368 — 2373 
225--X11—233-—2Z41--X63--22:169—2274 
225 ＋211— 233 242--Z£64-4-2370—2275 


225 ＋ 211 — 234— 242+ 65 ＋ 2271-2276 
225 ＋ 212 — 34 — 43 + 865 ＋2872— 22877 
2255+ 212 — 234— 244 ＋ 2266 ＋ 2273 — 22778 
226 ＋ 212 — 235 —244+ 267 ＋2273 2279 
226+ 212 — 2835 - 245 ＋ 868 ＋2274 2280 


226+ 212 — 236 245+ 869 ＋ 2275 — 2281 
226 ＋ 212 36 — 246 ＋ 270+2276—2282 
226+ 213 — 237 246+ 270+2277—2283 
226+ 213 — 237 — 247+ 271+2278—2284 
226+ 213 — 237 — 248 + 272722792285 


226+ 213 — 38 — 48 ＋ 273 ＋2280 - 2286 
226+ 313— £338 — £49 -- 3274-- 2381 —22287 
226+ 213 - 239 —3:49 4- 3275 4- 22282 — 2288 
226 ＋ 13 - 39 TSO ＋ 276 ＋ 2283 - 2289 
226 ＋ 214 40 550+ 276 ＋ 2284 22890 


256+ 814 40 — 251 ＋ 3777-2285 — 2291 
226+ 214—241—2551+ 278 ＋2286— 2292 
227+ 214—241—252+ 279 ＋2286— 2293 
2257+ X14 — 3:41 — 2253 4- 280+ 2287 — 22294 
227 ＋ 214—242—253+ 281+2288—2295 


227+ 214—242—254+ 282+ 22289 — 2296 
257+ X15— 343— E544 2824-2290 —22397 
227+ Z15— 243 — 255+ 3:83 - 22291 — 2298 
257+ 215—544—255+ 284 ＋2892— 2299 
227+ X15— 244 — 256 ＋ 85 ＋ 2293 22100 
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CHAPTER 10 


FUNCTIONS WHICH ARE NOT 
POLYNOMIALS 


10.1 LINEAR FUNCTIONS 
The problem to be discussed in this section is that in which the 
variable Y is a linear function of p+ 1 variables X, XI, ..., Xp, 
p 
j=0 
When n observations y; of weight w; are made at values æ of 


the independent variables X; (supposed free from error), the least- 
squares function 


p 
% [z] = > 5,;2; (2) 
j=0 
will satisfy the condition that 
2 
Se = 22 bp; 2 
J 


should be a minimum. Differentiation with respect to b leads 
to the normal equations 


with Pik = > Wi V Tki (3b) 
and M, = E, Wi Yi Eri- (3c) 


These equations are formally identical with the polynomial equa- 
tions if z; is replaced by . Hence they can be solved by the 
standard Doolittle technique described in Ch. 7. 

Corresponding to the orthogonal polynomials will be the ortho- 
gonal functions P 
T(z) = Pas Th (4a) 


for which Èw; T;(x;) T,(z;) = 0. (4b) 


a, can be expanded in terms of these functions in the form 


k 
Ty = As T;(2). (4c) 
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Clearly the treatment will be precisely analogous to that of $ 7.2. 
The fitted function in terms of the orthogonal functions will be 


U,(%) - Xa Zyx), (5) 


where the coefficients a; are the quantities occurring in the 
Doolittle scheme. The standard deviations of the estimated 
coefficients 6,; and of the fitted function w,(z) will be given by 
the formulae 


p 
var b>; = * E Biel Si = o° Xjj (6a) 
9 2 2 ° 
amd var u () = o° 5700/8 = と Tj Xx. (6b) 
de T 


Vi being an element of the inverse matrix. 

If it is desired to obtain the form of the fitted function when 
the variables u, * ,,... are omitted, this can be done very 
simply by calculating 5,; in the form 


D 
b, = > Bj. ay. (7) 
k=j 


For example, the value b,. , ; would be obtained by dropping the 
term 5, ap 
The variance of an observation can be estimated from the 


formula Xw,v?[(n — p — 1), (8) 


and the usual significance tests can be applied to the various 
estimates. 

The variables denoted by X, may be complicated functions of 
other parameters—for example, (1) may be of the form 


Y = Bo BIZ B,e-7? + B} cos ot + B, T'(Z) 


where X, = e, X, = cos cot, etc. The only restriction is that 
the function must be linear in all the parameters B,; to be 
estimated. 


10.1.1 Example 


In Table 10.1, the quantities y correspond to the difference in seconds 
between the time as given by a quartz clock and a transit circle. The values 
are actually averages over a 25-day period. The quantities z represent the 
corresponding dates, referred to an origin near the centre of the range. It 
is desired to represent the clock error by an equation of the form 


u = bb, z+ b, z? + b, cos 0 + b, sin 0, (1) 
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where の = 272/365 is an angular coordinate which corresponds to a periodic 
variation of error whose period is one year. This coordinate would take 
account of variations due to seasonal temperature changes and to corre- 
sponding changes in the earth's rotation. 


TABLE 10.1 


Clock error y as a function of the date x 


= 222/305 
y の 0 y x 0 
1-648 ー 347-9 16? 54’ 29-251 25-8 25° 24’ 
2-854 — 328-5 36? 00’ 31-286 51-2 50° 30° 
4-664 — 300-2 63° 54’ 33-072 72-8 71° 48° 
6-309 — 275-8 88° 00’ 35-445 100-9 99° 30’ 
8-012 — 250-7 112° 42’ 37-407 124-5 122° 48’ 
10-020 — 222-1 140° 54’ 39-623 150-1 148° 00’ 
11-590 — 199-8 162° 54’ 41-959 176-6 174^ 19 
13-411 — 175-0 187° 24’ 44-085 200-2 197° 30’ 
15-234 — 150-4 211° 42’ 46-206 223-9 220° 487 
17-143 ー 125-5 236° 12’ 48-584 250-5 247° 06’ 
19-198 — 99-8 261° 36’ 51-084 277-3 273° 30’ 
20-916 — 77-7 283° 24’ 53-023 299-0 294° 547 
23-281 — 48-0 312° 42’ 55-701 327-5 323° 00’ 
25-078 — 25-4 334° 54’ 57-394 345-5 340° 48” 
27-244 +0-9 0° 54’ 


To obtain the normal equations, columns of the values 2°, x, z?, cos 0, 
sin 0, and y are formed in Table 10.1.1, suitable powers of ten being 
removed to bring them to the order of unity so that & check column can 
be used. The various columns are intermultiplied to give the values at the 
bottom of the table. 

The equations are solved in Table 10.1.2 by the square root method. 
The quantities from Table 10.1.1 have been divided by an extra factor 10* 
to bring them to the order of unity. Since the two curves likely to be of 
interest are the full curve of (1) and the curve omitting the periodic terms, 
the inverse matrix for each of these cases has been calculated. The estimated 
standard deviation of an observation is obtained from (10.1,8). Thus 
ss = 10-*4(1825/26). The standard deviation of ba, is obtained from 
(10.1,6a). The fitted curves are obtained by multiplying the coefficients 
and standard deviations by 10/107, 10 being the factor removed from 
y and 107 the factor removed from vj. The two curves are 


u, = (27-047 + 0-023) + (80-806 + 0-075) x 10-8 x + (20-77 + 0-40) x 10-5 x? 


u, = (27-062 + 0-018) + (80-817 + 0-061) x 10-3 z + (20-45 + 0-31) x 10-52? 
+ (79 + 17) x 10-? cos 0 + (8 + 18) x 10-? sin 0. 


It would appear, then, that an annual variation of signifieant amplitude 
is present in the series of observations. 
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TABLE 10.1.1 


Calculations of normal equations 


Factors removed: 


— 102 104 1071 1071 10 = 

20 * x cos 0 sin 0 y z 
1 一 3.479 12-103441 十 9.568 十 2.907 0-1648 4- 22-264241 
1 — 3-285 10-791225 + 8:090 十 5.878 0-2854 + 22°759625 
1 — 3-002 9-012004 + 4:399 + 8:980 0-4664 + 20-855404 
1 — 2-758 7-606564 + 0-349 + 9-994 0-6309 +16-822464 
1 — 2-507 6-285049 — 3-859 49-225 0-8012 十 10.945249 
1 — 2-221 4-932841 — 7-760 + 6:307 1-0020 + 3-260841 
1 —1:998 3-992004 — 9-558 + 2-940 1:1590 — 9-464996 
1 — 1-750 3-062500 — 9-917 — 1-288 1:3411 — 7-551400 
1 — 1-504 2-262016 — 8:508 — 5255 1:5234 — 10-481584 
1 — 1-255 1:575025 — 5:563 — 8.310 1:7143 ー 10-838675 
1 — 0-998 0-996004 — 1-461 — 9-893 1:9198 — 8-436196 
1 — 0:777 0-603729 +2317 — 9:728 2-0916 — 4-492671 
1 — 0-480 0-230400 + 6.782 — 7:349 2-3281 + 2.511500 
1 — 0-254 0-064516 4- 9-056 ー 4:242 2-5078 十 8.132316 
1 + 0-009 0-000081 + 9-999 + 0:157 2-7244 + 13-889481 
1 十 0.258 0-066564 + 9-033 + 4-289 2-9251 4-17:571664 
1 +0-512 0-262144 + 6-361 十 7.716 3-1286 +18-979744 
1 十 0.728 0-529984 43:123 + 9-500 3-3072 +18-188184 
1 + 1-009 1-018081 — 1-650 + 9-863 3-5445 + 14-784581 
1 41:245 1-550025 — 5-417 + 8:406 3-7407 + 10:524725 
1 4- 1:501 2-253001 — 8-480 + 5-299 3:9623 +5-535301 
1 +1:766 3:11875 — 9-940 4- 1-011 4:1959 + 1-142656 
1 4- 2-002 4-008004 — 9-537 — 3-007 4-4085 — 1-125496 
1 4- 2.239 5-013121 — 7-570 — 6-534 4-6206 — 1-231279 
1 + 2-505 6˙275025 — 3:891 —9-212 4-8584 + 1-535425 
1 十 2.77 7-689529 +0:610 — 9-081 5-1084 + 7-199929 
1 + 2-990 8-940100 +4210 — 9-070 5・3023 + 13-372400 
1 4-8-275 10.725625 + 7:986 — 6:018 5:5701 + 32-538725 
1 + 3:455 11-937025 + 0:444 — 3-289 5.7394 + 28.286435 
29  — 0-001 126-904383 — 1-793 — 0-704 81-0722 234-478583 
126-904383 — 0-832790 — 0-273380 —171:793438 102-526498 56-530272 
995-933807 172-270611 — 8-973763 363-253474 1648-555721 
1449-332775 5-933602 — 0-409027 1625-061581 
1450-645518  —140-802630 1134-305289 
309-672756 715-313271 
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10.1.2 Elimination of non-significant variables 


When the fitted function is examined it will often be found that 
the contribution of one (or more) of the variables is negligibly 
small. This will be evidenced by the value of the corresponding 
coefficient being considerably less than its standard error. It will 
usually be necessary to fit a new function from which the non- 
significant variable has been omitted. 

If the variable has been placed last in the fitting scheme the 
values for the coefficients when it is omitted can be obtained 
without further calculation. For example, if the variable sin 8 is 
omitted from Table 10.1.2, the coefficients b,; are those listed in 
the line corresponding to 2 = 3. However, the elements of the 
inverse matrix must be recaleulated. From (7.3.4.1,1), 


(Op ュー (X;k)p — pi Lr · 

It is clearly very desirable that any variable whose significance 
may be doubtful should be placed last in the fitting scheme. 
If à variable occurring elsewhere in the scheme is to be eliminated, 
it is probably best to draw up a completely new scheme. 


10.2 NON-LINEAR FUNCTIONS 


If in the equation connecting the variables the parameters B/, 
which are to be estimated occur in a non-linear form, it is 
necessary to apply a transformation which will convert the equa- 
tion into a linear one. This can be done either by a change of 
variable or by using approximation methods based on a Taylor's 
series expansion. 


10.2.1 Change of variable 


The variables are to be changed so that the equation is linear 
in the unknown parameters. A commonly used change of variable 
is that employing logarithms. For example, if 


Y = AHB ZO 


where Y, H, and Z are measured and A, B, and C are to be 
estimated, taking logarithms gives 


log Y = log A+ Blog H + C log Z, 

or Y’ = >B, X,, 

where X,=1, X,=logH, X,=logZ, Y'= log Y, 
B,=logA, B,= B, B,= C. 
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The normal equations have the usual form 
Eb, EW; t Cpi = EW, Yi Ekis (1) 


but the weights w; should be the weights of the transformed 
variable y;. Now, from (1.2,14a—c), 


w,ocl/vary; = 1 / | ( 动 Var v) i 


oY;\3 
or wi C ws [. 2a 
1 i £Y, ( ) 
For example, if a logarithmic transformation is employed, 
7 ax 10, F3 ‘ 


In practice, the true values F, are unknown, and the observed 
values y; must be used in their place. Thus for the logarithmic 
transformation the weights would be 


+ — 9 2 
Wi = iyi. 


Even if the original observations were all of equal weight, the 
transformed observations must be weighted, for otherwise the 
estimates will be inefficient and the standard deviation calcula- 
tions completely incorrect. l 


10.2.2 The simple exponential 
The exponential curve 


Y = Ae (1) 

occurs in many branches of science. On taking logarithms, 
Y’ = B,+ B, X, (2a) 
where T = nF. P+ = nA, BI -A, (26) 


In signifying logarithms to the base e. The weights w; are propor- 
tional to 20 y?. 


The counts No recorded by a Geiger counter in one-minute intervals with 
thicknesses t of lead interposed between the counter and a radium source 
are shown in Table 10.2.2. It is proposed to fit an exponential curve 
A et to these values in order to determine the absorption coefficient u 
of gamma rays in lead. Taking logarithms, 


InN = In A — pt. 


The observed values N, are made up of two parts, the part N due to gamma 
rays and the background count v. With the present counter the average 
value of y is 72. The values N = No- are given in the third column of 
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Table 10.2.2, and the logarithms in the fourth column. The weights w; 
are proportional to 1/N,, as the counts follow & Poisson distribution 
(§ 4.3). Hence the weights w in the logarithmic form are N*/N,. The 
values / are listed in the fifth column, and the products (/w’)¢ and 
(Jw) InN in the two following columns. The normal equations for nA 
and u, are obtained by intermultiplying these columns, and are solved by 
the abbreviated Doolittle technique. The estimate of p is 


u = 0-627 + 0-033. 


TABLE 10.2.2 
Absorption of gamma rays by lead (Example 10.2.2.1) 


Observations Nọ Background v = 72 Corrected counts N = N,—v 
Lead thickness (cm.)7 Weights w = N°/No 


(a) Observed values 


, 


y = 
t N, N jm パー4 | Jw’ t Ju y! yo の を 
0 327 255 1:54126 14 0 21:5776 35-5776 
0.2 | 292 220 1:39363 13 2-6 18:1172 33-7172 
0-4 244 172 1:14749 11 4-4 12-6224 28-0224 
0-6 | 236 164 1-09987 11 6:6 12-0986 29-6986 
0:8 | 210 138 0:92725 9 7˙2 8・3452 24・5452 
1:0 192 120 0.78749 9 9-0 7.0874 25-0874 
1-2 | 185 113 0-727739 8 9-6 5・8191 23・4191 
1:4 172 100 0-60517 8 11:2 4:8414 24-0414 
1:6 170 98 0:58497 7 11:2 4-0948 22-2948 
1-8 160 88 0-47734 7 12-6 3・3414 22-9414 
2-0 | 139 67 0-20469 6 12-0 1:2281 19-2281 


(b) Normal equations and the abbreviated Doolittle scheme 
1031 705-6 1093-140 2829-740 


848-32 519-154 2073-074 
1306-142 
1031 705-6 1093-140 2829-740 1159-026 
1 0-684384 1-060272 2-744656 147-116 
365-419 — 228-974 136-445 143-476 
1 — 0-626605 0-373394 3-640 


s = 4(3-64/9) = 0-636 s(u) = s/J365 = 0-033 


10.2.3 Linearization 
In this section it will be supposed that Y is of the general form 


Y = F(X;;B,). (1) 


Estimates b, of the parameters B, are to be obtained from the 
observations y; the values z;; being supposed free from error. 
The residuals are 

Vi = y, — F (Xj; by). (2) 
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The fundamental idea, underlying the linearization process is the 
expansion of the term F(z;,;b,) as a linear function. Thus 


eu = Plew) x (h). bi (3a) 
k ( / 
where b, = b" + bi» (3b) 
bf being an approximation to b. Then if 
yi = yi— F(z; b, (4a) 
x = a» (45) 
(2) becomes UV. = yi— > b, Bhie (5) 


The least-squares principle states that the parameters are to be 
chosen to minimize To, vf. Thus (5) leads to the normal equations 


>u [i BB el) ne o (6) 


of the standard form, which can be solved for b¿. Hence the 
estimates of the parameters will be 
b, = bo + bi. 

Strictly, the b, are only approximations, since the expansion 
(3a,b) is valid only if b; is small. If, in fact, these values are 
large, it may be necessary to repeat the calculations, with b} 
replaced by the value b., to give a further approximation. How- 
ever, if the original estimates b? were well chosen, this will not be 
necessary. 

In some problems there are no independent variables X;, but 
the Y; are functions of the parameters alone, 


Y, = F(Bj, i=1ton. (7) 
The treatment given above will apply in this case, with 
y; = Yi— F,(bb).- 
10.2.3.1 Implicit functions. The cases to be considered are 
those in which Y is related to the X, by means of the function 


F(Y, X; By) = 0. (1) 
Then, since the fitted value y;— v; satisfies the same functional 


relationship, 


の OP. z 
F(y; vt, 25; b,) = 0 = F (y; ; be) » (25) "e > (T), (2) 


where b, = b° + b+, 


23 
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be being a reasonable approximation to b,. Hence 


Xw,v$ = Xwi;(y; — X5, Lr)’, (3a) 
where Vt = Fw X45 b), (3b) 
OF I 
zm 一 一 | 二 |， (3c) 
ki E , 


w; = «Jy. (3d) 


Y jr 
For the new variables defined by these equations the normal 
equations have the standard forms. However, the treatment will 
be approximate, no matter how close the values b? are to b,, 
because it is assumed that v; is so small that higher terms of the 
expansion (2) may be neglected. 


TABLE 10.2.3 
Observations of delayed coincidences (Example 10.2.3.2) 


Counts per 100 Sensitive interval 
seconds (microseconds) 
y t 
2-32 + 0-06 1-02 
4-18 + 0-10 3-17 
4-97 + 0-12 4-49 
7-27+0-18 7:46 
10-56 + 0-26 12-6 
13-56 + 0-30 18-3 
15-51 + 0-40 23-0 
18-00 + 0-45 29-2 
21-02 + 0-50 40-6 
22-70 + 0-60 48-2 
23-98 + 0-60 58-8 
25-50 + 0-65 71:5 
25-51 + 0-65 96-0 
25-82 + 0-65 119 
25-87 + 0-65 141 


10.2.3.2 Example 


In an experiment on delayed coincidences (Murdoch, 1953), the number 
of coincidences per second was measured as a function of the time interval 
over which the recorder was sensitive after & pulse had appeared in the 
first counter. The observations are shown in Table 10.2.3. It can be 


shown that 
y = A Bel, (1) 


where y is the coincidence rate, t the sensitive time interval, and À is the 
decay constant to be determined. For convenience y will be taken as the 
number of coincidences in 100 seconds. 
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First, approximate values of the three quantities 4, B, and À must be 
* Since y is small fort = 0, 4 B. For t= cc y = 4427. At 
pz ; Sd as 
y = 27(1—e-1) = 17, 


and so from Table 10.2.3 M is unity for t=26. Hence suitable initial 
approximations are 


A, = By = 27, Ay 0-04. 


TABLE 10.2.3.1 
Calculation of values ag, / (Example 10.2.3.2) 


a? 
ご 


0-96002 26-438 + 1:24054 1-54491 
0-88092 «x + 0-96484. 1-83790 
0-83561 ° --0-53147 1-70886 
0-74201 ° + 0-30427 2-05686 
0-60412 52 — 0:12876 2-32232 
0-48095 37: — 0-45435 2-44110 
0-39852 247・ 一 0.72996 2-34632 
0-31099 245: — 0:60327 2-53754 
0-19711 a — 0-65803 2-305056 
0-14544 E — 037312 2-387424 
0-09518 ° — 0-45014 1-9657 

0-05727 ë + 0-04629 2-09462 
0-02149 55- — 0-90977 0-62574 
0-008577 : — 0-94861 0-31822 
0-00356 3 — 1-03388 0-09806 


の (o -1 135 


1・ 
3- 
4- 
7. 
9. 
8: 
3. 
9. 
0. 
8 
8 
1 
6 
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1 
1 
2 
2 
4 
4 
5 
7 
9 
119 
141 


x = F = 1, 
zí = FE = —e7«t, 
a, = の 7/8A。 = tB, et, 

y = y— A+ B, e^t. 
The calculation of these quantities is shown in Table 10.2.3.1. The calcula- 
tion of the normal equations is shown at the top of Table 10.2.3.2. The 
values / are taken as the integers nearest 1・2/s。。 8, being the standard 


deviation given in Table 10.2.3: that is, o is taken as 1.2. 
The solution of the normal equations is 


b, = —0-41, bí = —1:81, 6, = —0-00388, 

and so the estimates of the coefficients in (1) are 

A = 27—0-41 = 26-59, B = 27—1-81 = 25-19, 

A = 0-040— 0-00388 = 0-03612. 
The sum of the squares of the residuals is 11-36, and so s is 0-97. This 
compares well with the value 1-2 of o— in fact, as in § 2.5.4, 
x? = 12(s/a)2 = 7-84 

with 12 d.f., and P(x?) = 0-80. 
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The standard deviation of À is found by dividing s or o by WSa = 10? /147, 
and so is 0-0008 estimated from s and 0:0010 estimated from c. Thus 
À = 0:0361 + 0-0010, 
and the half-life, defined as 0:6931/A, is 
T = 19:2 + 0:5 microseconds. 


The values A, B, and À may now be used to recalculate the columns of 
Table 10.2.3.1, and using these new values a further approximation can be 
obtained. It is found that the next approximation does not differ 
appreciably from the approximation calculated above. 

The column 2“ in Table 10.2.3.1 is made up of values 

2 = 1+x1-+ 10-22; +°, 
the factor 10-? being removed from 2% to bring it to the order of unity. 
This column is useful in checking the multiplications by win Table 10.2.3.2. 
If these are free from mistakes, the sum z, of a row of Table 10.2.3.2 should 
equal z; 4w 


TABLE 10.2.3.2 
The normal equations for Example 10.2.3.2 


Factor removed: 23, 10? 


Aw way (wx, wy’ を 
20 ー 19-2004 5-2878 24-8108 30-8982 
12 — 10-5710 9-0478 11-5781 22-0549 
10 — 8:3561 10-1300 5:3147 17-0886 
T ー 5:1941 10-4622 2-1299 14-3980 
5 — 3-0206 10-2760 — 0-6438 11:6116 
4 — 1-9238 9-5056 ー 1-8174 9-7644 
3 — 1-1956 7-4244 — 2-1899 7-0389 
3 — 09330 7-3554 — 1-8098 7・6126 
2 ー 0-3942 4:3214 — 1-3161 4:6111 
2 — 0-2909 3-7856 — 07462 4-7485 
2 — 0-1904 3-0222 — 0-9003 3-9315 
2 — 0:1145 2-2112 + 0-0926 4:1893 
2 — 0-0430 1-1140 — 1-8195 1-2515 
2 — 0-0171 0-5508 — 1-8972 0-6365 
2 — 0-0071 0-2710 — 2:0678 0-1961 
780 — 662-0781 553-1592 663-4128 1334-4939 
592-6210 — 404-9195 — 643-4726 — 1117-8492 
675-7205 243-9500 1067-9101 
808-4930 1072-3831 
808-4930 
780 — 662-0781 553-1592 663-4128 1334-4939 564-2520 
H — 0-848818 0-709178 0-850529 1:710890 244-2410 
30-6372 64-6120 — 80-3559 14-8932 210-7591 
1 2-108939 — 2.622820 0-486116 33-4819 
147-1694 — 57-0621 90-1075 22-1247 
1 — 0-387730 0.612271 11-3572 
— 0-406721 — 1:805121 — 0-387730 
0-593275 — 0-805126 0-612271 


一 一 
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10.3 HARMONIC ANALYSIS 


The general form of a periodic function of fundamental period T is 


Y = A; EA, cos jo + > B; sin j6, (1a) 
j j 


where 0 = 2zt/T. (15) 


If the data are in the form of a, continuous curve, there are 
various mechanical, optical, and electrical instruments which 
have been devised for the evaluation of the coefficients. These 
will not be discussed here. If the curve is to be analysed mathe- 
matically, it is simplest to replace it by a set of points spaced at 
equal intervals of 0. 

If there are n observations y;, at points 0,, the least-squares 
coefficients are given by the normal equations 


sin E, 


os n % (2) 


Lw;(y; — a, — Xa; cos jô; — Xb; sin jb, 

10.3.1 Equally-spaced, observations 
When the n observations are uniformly spaced throughout the 
cycle, and are all of equal weight, the solution of the normal 


equations is greatly simplified. It will be supposed that the 
observations are at angles 


0; = mijn = i$, i= O to n-. (1) 


Now the standard formula for the sum of a cosine progression 
gives 

n—1 

> cosmig = sin mn cos m(n 一 1) sin 1$, 

i=0 
and this will vanish for integral values of m since mund = mz. 
Thus the sums of the form 


X sin jo, sin kb; = y> {cos (k —j) i$ — cos (k +j) i$) 


will vanish unless k = j, the value then being zu. In fact, the 
functions cosj0, sin jd are orthogonal over the set of angles 0 to 
(n — 1)9z[n. The normal equations (10.3,2) then have the simple 
forms 


a; = 2(Yy,c0sj0;j|n, a= Nn, (2a) 


Some authors include a factor à before A, in (10.3,1a); their 
formula for a, is then 2Xy;[n. 


342 POLYNOMIALS AND OTHER CURVES 


From (2a) the variance of z; is given by 


(2/n)? (= cos*j6,) es 
i 
and so vara; = 20% = varb;, (3a) 
var dy = /n. (35) 


The variances of all the coefficients (except ao) are the same. 
The covariance of dn, by is 


(40% 2 >; cos j0, sin k6;, 
and so cov (a,, by) = O = cov (dj, a) = cov (b;, bx). (3c) 
The variance of the fitted value 
p p i 
wu, (0) = a + X a; cos j0 + > b;sinj0 (4a) 
j=l j=l 
will then be 
vara + > (cos? jð var a; +sin®j@ var b;), 
j=1 
or var u) = (2p + 1) o°/m. (45) 


The variance of the fitted value is independent of the angle 0. 
The standard deviation of an observation may be estimated 
from 2»? in the usual way. The value Xv? is 


Ev) = Ly? —naz— > aj > cos? 76; — > b? > sin? j6,, 
or Lv? = Sy na In (3989. (5) 
j 


The expectation of this is (n — 2p — 1) o, and so 
v?/(n — 2p — 1) (6) 


wil provide an estimate of the standard deviation of an 
observation. 


10.3.2 n a multiple of four 
If n = 4q, the values of cos 0, for i = r, 2g—r, 2q--r, 49 —r all 
have the same magnitude. Hence (10.3.1,2a) becomes 


2qa; = b 8 "um ( = y (Yoq—r + Vor )} cos %, (la) 


Similarly, (10.3.1,2b) becomes 


q—1 * ` .` 
= PI ( T y — Y2a+r)} sin j6,. (15) 
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If the observations are grouped to give the quantities 


ar = Yr + Ne- + Na- + Yogirs (2a) 

o = Y, + 4 Vog-r — Y2q+r> (2b) 

B, = Yr—Yaq—r + Yoq—r Mare; (2c) 

Br = Yr—Yaq—r — Year + Vat (2d) 

then 2ga, = Ta, cos 70%, k even, (3a) 
2qa, = Xa’ cosr0,, k odd; (3b) 

2gb, = >B; sin rh,, k even, (3c) 

2qb, = X,sinr0,, k odd. (3d) 


The values cosr@, and sin+0, are listed in Table 10.6a for n = 8, 
12, 16, and 24. From (10.3.1,1), 10% = た の. 

The formation of the sums (3a-d) is illustrated in Table 10.3.2 
for the specific case n = 12. The equation 


» „ a= 
Xo; + Da; + EB; EB; = 4 ZU (4) 
will provide a check on the formation of these quantities. 


TABLE 10.3.2 


Formation of the sums a, B when n is a multiple of four 


十 十 十 十 十 一 一 十 十 十 一 一 キー キー 
List a 0 B 8 
Yo Ye Yo T Vs Vo — Je Vo — 7 Vo T ys 


71 75 7? Ui (T sess+3/ tu Yi Vs Ye J Ts [2-0 Yı—Ys 7 — Yu 
72 J Ys Yio YatYatYst¥io 9s 一 4 一 9s 十 9 が ho が s 十 74 一 8 一 mo Ya— Va" Vs — V10 
Ys Yə Vs T ys Vs — Ya Ys — Yo Ys + 


10.3.3 Harmonic curve through all the points 
If n coefficients are determined, the curve will pass through all 


the n observed points, and Xv? = 0. 
If n is even, only one of the coefficients 4%, Bi, can be esti- 
mated. It is usual to estimate 4,,. Since 


È cos? 4n6, = T cos*ia = n, 


ay, = (Ey, cos 4n8,}/n. (1) 
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If all the n coefficients are evaluated, the following equations 
will provide a, check on the arithmetical calculations: 


22, sin k(2m[n) = y — Yn- (25) 


These are obtained by equating the fitted values at 0 = 0, 2z/[n, 
and 2z(n — 1)/n to the observed values zç, Yı and y,.. 


10.3.4 Example 

Fig. 10.3.4 shows the waveform of the output voltage from an overloaded 
transformer-coupled amplifier. The amplitudes at intervals of one-twelfth 
of the cycle are recorded at the left of the top section of Table 10.3.4, and 
the quantities x, 8 are calculated at the right. 

The coefficients a, b; are then calculated by multiplication of these 
columns by the columns of Table 10.6a for n = 12. The calculations are 
checked using (10.3.3,2a, b). 


TABLE 10.3.4 
Calculation of harmonic amplitudes for the waveform of Fig. 10.3.4 


十 十 十 十 十 一 一 十 十 十 一 一 十 一 十 一 
yi a a B B' 
— 6-0 + 11.9 5:9 一 17.9 一 17.9 十 5・9 
一 0.3 +11:2 十 8.4 —10-7 十 8・6 — 30-6 4- 13-2 + 7-6 
+44 十 9.8 一 1.4 一 11.4 +1-4 — 15-4 -27-0 4- 4-6 
+ 7-9 — 8-0 ー 0-1 15:9 + 15-9 — 0-1 
Check Sa = 24-0 
12a, 15-8 
12a, —1:2 
6g。 9-60 6b, 10・56520 
6g。 0-80 6b, 2・59800 
6a, — 52-09960 6b, 45:882 
6g。 + 0-89960 6b; — 0-882 
6g。 一 2.5 6b, 一 2.7 
ao 1.3167 
41 — 8:6833 b, 7-6470 
Qs 1-6000 b, 1-7609 
Gs — 0-4167 ba — 0-4500 
CA 0-1333 b, 0-4330 
ds 0-1499 b; 一 0.1470 
ae 一 0.1000 


Check Xa; = — 6:0001 2 b, sin 77/6 = 10-3998 
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10.3.5 Amplitude and phase 
The fitted curve may be required in the form 
Y = C,4- ZC;sin (J +D;), (1) 
where C; is the amplitude and D; the phase of the jth harmonic. 
On expanding the sine term, and comparing with (10.3,1a), 


C,cosD; = B, O,sinD; = A; (2a) 
or C? = A?+B?, tan D, = A,/B;. (2b) 
Hence the least-squares estimates of C; and D; will be 

c = a?+b?, d, = tan-la;Jb;. (2c) 


Fig. 10.3.4. Output voltage of an overloaded amplifier. 


The variance of c; will be given by 
varc; = var af +b?) = (Aj vara, +B} var b;)/(Aj + Bj), 
and so varc; = vara; = 20% n, (3a) 
var co = n. (35) 
The variance of d; can be calculated from 
var tan d, = sect D, vard;. 
Thus vard; = Bj(A? + Bj)? var (a;|b;), 
or var d, = 200. (4) 
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10.3.5.1 Example 


The amplitudes and phases of the components of the waveform drawn 
in Fig. 10.3.4 are caleulated in Table 10.3.5. The standard deviations are 
evaluated using for c a value 0-2, this representing the error in the measure- 
ment of the waveform amplitudes y; at the points 0, 

The components of the waveform up to the fifth harmonic are given by 


u(£) = 1:32 + 11:57 sin (0 — 48° 38’) + 2-38 sin (20 + 42°) 
+ 0-61 sin (30 — 137°) + 0-45 sin (40 + 17?) + 0-21 sin (56+ 134^). 
TABLE 10.3.5 
Amplitudes c; and phases d; for the waveform of Fig. 10.3.4 


c = 0:2 
o° (c) = 20% n  c(c) = 0-082 olco) = o(c)/J2 = 0-058 
o(d) = {o(c)}/c radians = 4-7/c degrees 
c c(c) d c(d) 
Cy 13167 0-058 
c, 11-5705 0-082 d, — 48° 38’ 24’ 
Cs 2-3792 0-082 d, 42° 16’ 2” 
Cs 0.6133 0-082 d,  —137?12* 8? 
C. 0-4531 0-082 d, 172097 10° 


e, 02100 0-082 d, 134°26’ 29° 


10.3.6 Correction for grouping 


In certain cases the observed values y; will be mean values 
over a certain interval—for example, mean monthly temperatures. 
The mean value will differ from the value at the centre of the 
region by an amount which depends on the shape of the curve in 
that region. Thus if Y? is the central value, 


dY 1 dY 
= e 一 一 一 一 — 2 
TF +H A65 402 (A0) 2, 
and the average value over the interval + 4¢ is 
1d?Y の 
, = " — Ë" 2 
Y= Y° +s qa $ | (01248, 
ui LU 
or Y, = Yitg jg (1) 
Hence if Y; = Ao LA, cos 0, + Z B; sin jo, ; (2a) 
then Y; = Ao + ZA; cos j0, + >B; sin j6,, (25) 


where 


i= A0 25;j* 9), Bj; = B,(1 +j 4). 
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Therefore the coefficients wj, b; obtained by fitting a curve to the 
grouped values y; should be corrected by multiplying by the 


factors (I +k j? 4?). 


10.3.7 Observations over several periods 
If observations are available over several periods, the values 
at 0, 0--2«, 0-- 4c, etc., can be grouped and the harmonie co- 


efficients determined from the grouped values. Thus if there are 
rn observations, and 


Yri = 21y(0;- Ang), (1) 
qd 
mo 
then a; = a Yri 0080, frn. (2) 
i-o 
nr—1 
Also Zw? = E (y,—a,— Xa, cos j0; — Xb; sin j6,)?, 
i=0 
1 
or Ev = Ly? na- 5 > nr(a?+ bb). (3) 
A 
Hence 82 = Lv?/(nr —2p—1) 


will give an estimate of c? based on nr—2p—1 degrees of 
freedom. 


10.3.8 The search for unknown periods 

It will be supposed that n observations y; are taken, at unit 
intervals of time, over a length of time much greater than the 
periods which are present. Then if an oscillation of period T is 
present, it will contribute 


A cos ic + B sin ic» (1) 


to , where w = 27/T is the angular frequency. 
If the first term in (1) is multiplied by cosiw’ and summed 
over the n values of 7, the formula 


sin 4n(w—w’) cos 1(n — 1) (zo — w’) 
14| —  —sinie-—e) 


sin 3n(c + w’) cos 1 (n — 1) (c +e )| 
* sin d(w + o”) 
is obtained. The first term will be large only if w—w’ is very 


small, when it has the value 4Ancos}(n—1)(w—w’), while the 
second term is never large. Hence 


^n—1 
> A cos io cos io! = n cos $(n — 1) (o —«'), wr’. 
0 
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By using similar expansions of products it follows that, when w’ 
is nearly equal to o, 


E(2/n) X3; cos io = A cos (n — 1) (c — w’) 
+ Bsin}(n—1)(w—w’), (2a) 


E(2/n) Sy, sin h = — Asin 1(n— 1) (の ー の 「) 
+Bcos}(n—1)(w—w’). (2b) 
Thus if ーー 
a = (2[n) Xy, cos io, b = (2/n)Xy,sinio’, (3a) 
then c? = a? +b? (3b) 
will provide an estimate of the amplitude of the frequency w in 
the neighbourhood of w’. 


10.3.9 Significance tests for the amplitude of a period 

If the deviations in y, are assumed normally distributed, then 
a and b will also be normally distributed. When the true values 
of the coefficients 4 and B are zero, the probability that the 
values determined will lie in ranges a Ida, b db is 


d Pla, b) = (n|4zo2°) (exp —n(a? + b2)/4o2) da db. (1a) 
On transforming to angular coordinates c, V, and integrating over 
the angle dP(c) = (m|2o?) (exp —ne?/40%} c dc. (1b) 


The probability of obtaining à value greater than or equal to c? 


is then 5 
Q(c?) = ef (exp 一 nz2J4o2) das, 
e 


or Q(c?) = exp —nc?|4o? e, (2a) 
where k = nc?[4c? = c?/H(c*). (2b) 


Hence the significance of a frequency component, can be tested. 
It will be noted that E(c?) is here equal to 4o2/m. The analysis of 
$ 10.3.5 does not hold when 4 and B are both zero. 

Sometimes the amplitudes of a certain number, m say, of 
frequency components are determined, and it is desired to test 
the significance of the largest of these. The probability that the 
square of the largest of m amplitudes is greater than or equal to 
c? is, from (2a), 

Qne?) = 1 —(1—e—)m. (3) 
No exact test is available for the other periods, but it is suggested 
that those periods which, when used in (3), give values of Q 
less than 0-5 can be at least tentatively accepted as real. 
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In these tests c is assumed known. In cases where o has to be 
estimated from the observations, Fisher (1929) has given a more 
exact test. Tables for use with this test and with the test based 
on (3) are given by Davis (1941). 

Hartley (1949) discusses a test based on the F-ratio 


nc? a 
ーー ua = }n(n—2p—1)c?/Xe%, (4) 
where p periods have been determined and £v? is the sum of the 
squares of the residuals. If the true value of the amplitude is 
zero, this ratio will be distributed as F with (2,n— 2p -— 1) d.f. 
To test whether the largest of p amplitudes is significant at a 
level o, the value F given by (4) is tested at a level x/p. If this 
period is significant, the next largest amplitude is tested at a 
level «/(p—1), and the tests continued till an amplitude below 
the significance level is reached. 

The difficulty with periodic analysis is that readings have to 
be taken over many periods in order to sort out the various 
frequency components, while in many branches of science the 
periods do not always persist unchanged for such long intervals 
of time. It is always advisable to divide the observations into 
two or more groups and to examine each group separately to see 
whether the major terms do remain unchanged. 


10.4 SMOOTHING. 


In the process of smoothing, graduation, or trend elimination, 
the smoothed value is obtained from the observations in the 
immediate neighbourhood of the point, rather than from the 
whole set of observations as in the standard least-squares methods. 
This is an advantage if it is suspected that the form of the curve 
changes radically from one end of the range to the other. The 
standard smoothing methods only apply to observations which 
are equally spaced. 


10.4.1 Least-squares smoothing 

One method of smoothing is to fit a least-squares curve of 
degree p to the n = 2m+1 values centred at each point. Then 
the smoothed value w, at any given point is 


% (0) = Xa; Boj 
or (0) = > {(1/n) + (Bos/ S22) Tale) + (Bo4/ S44) Ta(€)} (e). (1) 
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Now (7.7.3, Ia, b) gives when e = 0 the equation 
p; = —Bo ial Bo, 3-1» 
and S/ is II/. Equation (1) can then be written 
% (0) = (1/pg) > (1 — (1/p3) To(e) + (1/po pa) T,(e))yg(e)- 


But from (7.7.3,1a, b), 
T»(«) — ps Lade) /e, T,(e)— pa 73(e)/e = T,(e)/e, 


and so us(0) = — (1/po P2) Zo) 
ーー(1/po P2) > (e? + B33) y (e), (2a) 

us(0) = (1/po Pa Pa) L CT (9)]6 (e) 
= (1/po pe pa) Z (et + Bas e+ Bis} Ye). (25) 


Explicit formulae can be written down by using the expressions 
for p; and B, listed in Table 7.10a. 

It is therefore not necessary to calculate the least-squares 
curve in its usual form to obtain w,(0). It is only necessary to 
multiply the observations at each value of e by the factors given 
in (2a, b). For tabulation of these factors the form 


%。(0) - È Zpol(€) y(<)/Zpo, (3) 


where the z; (e) are the least integers, is more useful. Table 10.65 
gives the values 230 for n from 5 to 13. Values of z, and 250 for n 
up to 21 are given by Kendall (Vol. II, 1948, p. 374) and by 
Whittaker and Robinson (1944, p. 295). Values for » up to 30 
have been given by Kerawala (see $ 7.6.4). 


10.4.2 Example 


Table 10.4.2 shows the calculation of the smoothed values, using a 9-point 
cubic, for the observations of Table 7.6.2.1. The observations are listed 
in order. The factors 230 (e) are written down from Table 10.65 on a separate 
slip of paper which is placed beside the observations. Table 10.4.2 shows 
the position of the slip for the calculation of the fitted value corresponding 
to the observed value 35. The y and z are intermultiplied and the sum of 
the products is divided by Z,, to give the fitted value ug. The slip of paper 

'is then moved down so that the arrow is opposite the next observation. 


10.4.3 Fitted values at the ends of the range 

The method described above is not applicable to the m = (n — 1)/2 
points at each end of the range. If fitted values are required at 
these points the polynomial fitting the first » points and the 
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TABLE 10.4.2 
Smoothing by means of a 9-point cubic (Example 10.4.2) 


y Eyz Us 
7 
3 
1 
(onaseparate 3 
slip of paper) 0 371 1:6 
E 850 3-7 
230 6 1653 7˙2 
— 10 2414 10-5 
—21 15 2747 11・9 
14 18 3223 14-0 
39 15 4848 21-0 
54 15 5807 25-1 
一 59 35 5268 22-8 
54 44 677: 29-3 
39 19 8733 37-8 
14 22 9916 42-9 
—21 74 10267 44-4 
50 10711 46-4 
Zao 231 38 10943 47-4 
37 8984 38-9 
29 5306 23-0 
16 3797 16-4 
7 2652 11-5 
3 1827 7-9 
10 1634 7-1 
13 2052 8-9 
10 2378 10:3 
8 
10 
6 
5 


polynomial fitting the last n points may be calculated. Again 
it is possible to use formulae of the form 


(J) = X2,5()9(9)/2Z,;- (1) 


zsi(e) is tabulated in Table 10.6c for value of n up to 13. The two 
fitted values at the very ends of the range will be rather inefficient. 


10.4.3.1 Example 

Table 10.4.3 shows the calculation of the fitted values at the extremes 
of the range for the example of $ 10.4.2. The fitted value at e = j is found 
by intermultiplying the z,, and y columns and dividing by Z, The 
observations at the end of the range are written down in reverse order. 
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TABLE 10.4.3 
Smoothed values at the extremes of the range 
Beginning End 


of range 
y 


Cf 
3 
1 
3 
0 
4 
6 
0 
5 


一 一 


10.4.4 Summation formulae 

When the number of values n over which smoothing is to take 
place is large, the calculation of least-squares values becomes 
rather tedious. In such problems it may be better to use a less 
efficient method such as the summation method to be described 
in this section. 

In deriving the summation formulae it is assumed that the 
function can be represented as a cubic over the range of the 
observations used to caleulate a, smoothed value. Then, using 
central difference formulae (cf. Whittaker and Robinson, 1944, 


kasus Y; = Y, + 4175? Y, + odd differences, (1a) 
where 82 J = LI - 270 ＋ . I. (15) 


The symbol »7[n]Y, wil be used to denote the mean value of 
the n observations centred on Jo. Then 


En3[n] yo = Y, - (n? — 1) ö J, (2) 
since Li? is n(n?—1)/12. Now 
n(n] ö Y, = 8° Y, +zz(n2—1)84Y, = 82 Y, 
if differences beyond the third are neglected, and so 
Uy = nn] {1 -Fn — 1) 83) gy, (3) 
will be an unbiased estimate of Jo. The means so formed may be 


averaged in a similar way, leading to general formulae which are 
written symbolically 


Up = ny! ng! ng [n] [n3] [ns] (1 — (N — 1) 82) y. (4) 
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Spencer's formulae are the most commonly used. If the values 
n; are 4, 4, and 5, 


uo = so[4] [4] [5] (1 — $82) yo, 


which is written 


uo SLI [4] [5] L- 9, 22, — 9] yo» (5a) 
where [一 9,22, — 9] yo = — Iyı + 229, — 934. (55) 


The factors are still rather large. Since 
8* Yo = ya — 4-1 + Óyo — 4% + Yo 


is supposed negligible, 384% can be subtracted from the right- 
hand side of (55), the formula 


uo = so[4] [4] [5][ — 3, +3, +4, +3, — 3] yo (6) 


being obtained. This is Spencer's 15-point formula, each smoothed 
value using 15 observed values. Spencer's 21-point formula 


Vo = 38015] [9] [7] [ — 1, 0, 1, 2, 1, 0, 一 1]9。 (7) 


is obtained in a similar way. In words, (6) states that the sums 
— 3/2 + 3y_, + 4% + 37 一 3y, are formed for all sets of 5 successive 
observations in the series. These are then summed in fives, the 
results summed in fours and then again in fours, and the final 
smoothed values obtained by dividing by 320. 

Values obtained by summation are not as accurate as the 
least-squares values obtained from the same set of points, but 
they are more rapidly calculated. The 15-point formula gives an 
efficiency of 0-78. For a (2m + 1)-point formula, no fitted values 
are obtained for the m points at each end of the sequence. 


10.4.4.1 Example 


In Table 10.4.4 the observations of Table 10.4.2 are smoothed by means 
of Spencer’s 15-point formula. The observations are listed in the first 
column. The sums —3y;-.+ 37,- ュ 十 4%/ T 37+ ュ ー 37+s, formed on a 
calculating machine, are given in the second column. These are then 
summed in fives (column 3), fours (column 4), and fours (column 5). The 
final smoothed values u are obtained by division by 320. 


10.4.5 Comparison of smoothing methods 


Figure 10.4.5 shows the plots of the smoothed values obtained 
from a least-squares curve fitted to the whole set (Table 7.6.2.3a), 
from a 9-point least-squares cubic formula (Table 10.4.2), and from 
a 15-point Spencer's formula (Table 10.4.4). 


24 
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The higher the value of » the smoother is the fitted curve. 
Alternatively, the lower the value of z the more closely does the 
fitted curve follow local variations. Clearly the appropriate value 
of n will depend on the purpose for which the curve is required. 
No general rule can be given, and the choice of the amount of 
smoothing desirable is largely a matter of personal judgment. 


TABLE 10.4.4 


Smoothing by means of Spencer’s 15-point formula 


y 2 3 ES 5 “ 

了 

3 

1 1 

3 —6 

0 0 11 

4 ー5 47 

6 21 134 413 
10 87 221 637 2988 9-3 
15 81 235 828 4026 12-6 
18 87 238 1110 5027 15:7 
15 9 416 1451 6097 19:1 
15 24 562 1638 7284 22-8 
35 215 422 1898 8527 26-6 
44 227 498 2297 9997 31:2 
19 — 53 815 2694 11749 36-7 
22 85 959 3108 13382 41:8 
74 341 836 3650 14465 45-2 
50 359 1040 3930 14713 46-0 
38 104 1095 3777 13666 42-7 
37 151 806 3356 11417 35-7 
29 140 415 2603 8627 27-0 
16 52 287 1681 5946 18-6 

7 ー 32 173 987 3901 12-2 

3 — 24 112 675 2836 8-9 
10 37 103 558 
13 79 170 616 
10 43 231 

8 35 
10 37 

6 

5 


Sum 533 2045 9826 37907 144648 452-1 


The sums of the columns can be used as a check on the caleula- 
tions. Thus 


37907 = 4 x 9826 — 3 x (11+ 231) — 2 x (47 + 170) — (134 + 103). 
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u 


10 15 20 
€ 
Fig. 10.4.5. Comparison of smoothing methods. The observations are marked 
with crosses, The solid line is the 62-point least-squares curve, the dotted line 
is the join of the 9-point least-squares smoothed values, and the dashed line is 
the join of the 15-point Spencer's formula values. 


10.5 NOTES AND REFERENCES 


(10.2) The linearization procedure is described by Deming (1943). The 
following two recent applications of the linearization procedure are of 
interest in physics. Dumond and Cohen (1953), Cohen e£ al. (1955), use it 
in the determination of the best values of the fundamental constants, and 
Breitenberger (1956) has discussed its use in the representation of nuclear 
scattering data by a series of Legendre polynomials. Price (1954) has 
considered how, by & suitable choice of angles, these polynomials may be 
made orthogonal to one another. 

Methods of representing data by a series of exponentials LA, exp Ar, 
have received some attention. If the values z are spaced at equal intervals, 
the values À, may be derived by Prony's method (Hildebrand, 1956, p. 378; 
Whittaker and Robinson, 1944, p. 369). The values so obtained are often 
not very accurate, and the method may give rise to spurious oscillatory 
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terms. Other references are: Householder (1949), Keeping (1951), and 
Cornell (1956). 

(10.3) References on Fourier analysis inelude: Jaekson (1941), Whittaker 
and Robinson (1944), Danielson and Lanezos (1942), and Worthing and 
Geffner (1943). Most textbooks on a.c. circuit theory amd on optics 
include a treatment of Fourier series. 

For the determination of unknown periods by the periodogram and the 
correlogram see the books by Brunt (1917), Whittaker and Robinson (1944), 
and Kendall (1948), and the paper by Kendall (19462). The determination 
of periods using the Prony method is discussed by Hildebrand (1956). 

Fisher's paper on tests of significance in harmonic analysis is reproduced 
in his book Contributions to Mathematical Statistics, John Wiley and Sons, 
New York, 1950. 

(10.4) Summation formulae are described by Whittaker and Robinson 
(1944) and Kendall (1948). A book by Sasuly (1934) gives details of various 
methods of smoothing. 


10.6 TABLES 


TABLE 10.6a 
Multiplying factors in harmonic analysis 


8 observations 
Upper Sa, 4a, 4a, 
Lower 8a, 4a, 
Sign 


Xo 1 
a, ^ 40-7071 
Oly 0 
4b, 
&/ 0 
B. 1 
B 0 
12 observations 
Upper 12a, 6a, 6a, 6a 
Lower 12a, 6g。 6g。 
Sign 
eo 1 1 Oy’ 1 1 
0 +1 +0°5 a, 30-8660 0 
es 1 一 0.5 | a 0.5 一 1 
es +1 Fl a,’ 0 0 
Upper 6b, 6b, 6b, 
Lower 6b, 6b, 
Sign 
Bo 0 0 B. 0 
B. 0:5 1 BY 0.8660 
Ba + 0-8660 0 52 +0-8660 
Bs 1 ー1 Bs' 0 
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TABLE 10.6a (cont.) 


16 observations 


Upper 16a, 
Lower 16a, 
Sign 


Xo 
1 ` + 0-3827 
— — 0-7071 
T 0-9239 
0 


8b, 


0-9239 
+0-7071 
— 0-3827 


24 observations 


Upper 
Lower 


Sign 


Xo 
Oy 
Qa 
Os 


Ho HIH 
222222 
to 00 -1 01 c2 
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TABLE 10.6 


Values zs (e) and Zz for use in smoothing by means of a cubic 
fitted to n points 


n 5 7 9 11 13 
€ 
6 —11 
5 — 36 0 
4 ー21 9 9 
3 — 2 14 44 16 
2 ー3 3 39 69 21 
1 12 6 54 84 24 
0 17 7 59 89 25 
—1 12 6 54 84 24 
—2 — 3 3 39 69 21 
—3 一 2 14 44 16 
—4 —21 9 9 
—5 — 36 0 
—6 —11 
グ 。。 35 21 231 429 143 


TABLE 10.6c 


Values z。,(e) for calculating the smoothed values at the 
ends of the range 


do - O = to n ss, 
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TABLE 10.6c (cont.) 


n= ji 

2 5 4 3 2 1 0 

€ 

5 678 288 48 — 72 — 102 — 72 

4 288 246 192 132 72 18 

3 48 192 246 232 172 88 

2 — 72 132 232 251 212 138 

1 — 102 72 172 212 206 168 

0 ー 72 18 88 138 168 178 
ー1 ー 12 一 24 2 52 112 168 
—2 48 —48 — 64 一 23 52 138 
一 3 78 — 48 — 88 — 64 2 88 
—4 48 —18 —48 —48 — 24 18 
一 5 ー 72 48 78 48 ー 12 ー 72 
Za; 858 

n= 13 

j 6 5 4 3 2 1 0 

€ 

6 2915 1452 462 —132 — 407 — 440 — 308 

5 1452 1100 792 528 308 132 0 

+ 462 792 920 888 738 512 252 

3 — 132 528 888 1004 932 728 448 

2 — 407 308 738 932 939 808 588 

i — 440 132 512 728 808 780 672 

0 — 308 0 252 448 588 672 700 
ー 1 — 88 ー SS 0 148 328 512 672 
— 2 143 — 132 — 202 — 116 77 328 588 
ー3 308 ー 132 ー 312 ー 288 ー 116 148 448 
一 十 330 一 88 一 288 一 312 一 202 0 252 
ー5 132 0 — 88 — 132 — 132 — 88 0 
—6 — 363 132 330 308 143 — 88 — 308 


Zs; 4004 


360 


CHAPTER 11 


GENERAL REGRESSION AND FUNCTIONAL 
RELATIONSHIP PROBLEMS IN 
SEVERAL VARIABLES 


11.1 MULTIPLE REGRESSIONS 


In multiple regression problems, observations z;, of p variables z; 
are made. The regression surface for the variable x, will be given 
by the function 


X, = Nl, ...,Zy p Spp の っ y), (1a) 


a function of the p — variables z;. 
It will be assumed for simplicity that the functions are linear, 


owe X, = EB. a, (15) 


The prime superscript on the summation sign indicates that the 
value £ is omitted. If the regression is, in fact, curvilinear, 
extra terms in 27 can be added to (15). The procedure for the 
estimation of the regression surface is unchanged if the regression 
is curvilinear, but the allotment of weights may be much more 
complicated. 

If n sets of observations z;; are made, the least-squares. esti- 
mates b, of the regression coefficients Bi, will be found from 
the condition that 

Xa, (z; — 2b, tji)? 


should be à minimum. This leads to the usual normal equations 
= 0. (2) 


The weights w; should be proportional to the variance of , for 
fixed &. In many cases it is not possible to ascertain these 
weights, and it is often assumed that w, is constant. 

The coefficient B}; is a measure of the dependence of x, on z; 
when all the other variables are held constant. 'This coefficient 
is often written Bz, 12. ,, the variables held constant being indi- 
cated by suffixes after the dot. There will be p regression functions 
of the form (1a). In particular, there will be a function 


X; ww Z Bur ax, 


Dw (z Lb 2; ) z 


mi 


Bj, being a measure of the dependence of z; on z, when all the 
other variables are held constant. The product B,;B,, will then 
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be a measure of the interdependence of z; and xy. This product 
is written 

Pix. = Bira Bis. (3) 


where 9 stands for the - 2 suffixes of the variables held constant. 
Pik.q is called the partial correlation coefficient of the variables 
x; and z,. The estimate of p obtained from the n observations 


will be ; 
Tj = A (Dj A bx. 4) - (4) 


11.1.1 Aecurrence relations for partial correlation coefficients 
From (7.1.2,7a), the equation giving 5,; 。 will be of the form 


576.0 bx. a = N. a: (1) 


where % is Cr u- The theory x the method of single division 
gives the recurrence relation (7.1.2,2a) 


Pri. 1 Pri. PEL" q—1 $a. PET PET (2) 


— 77 q—1 Paa. q-1^ 2 xq. q—1 ) $a. E 
(3a) 
$5 .q—1 $qq.q-1 — $4.a-1 $5 a 


Hence 5775 


which can be put in the form 


b — by, bas 
b kj.q—1  “kq.q-1 I. 3b) 
Matt do — bja.a-1 box.o-a 


Since the quantities / , , are symmetrical, it follows from 


(3a) that 
(b, b; o 
Prs. 21 Paa. q—1 — xa. q—1 Pig. 4... 


= ($5. q—1 dag. q—1 — dig, q—1 Paj. — ($a. q—1 $e. q—1 — Prq. q—1 Pak. cu 


which simplifies to 


Tik q-1— "ja.a-1" ka.a—1 
Tik. = 2 q . (4a) 
T (1 T EM, (1 m PSP) 


The correlation coefficients can then be expressed in terms of 
those of lower order. In particular, 


712 — 713 723 
» » 29 wu 4b) 
ma = G4 CI. 


where the „ are the zero-order coefficients, 


E (tji — ,) (Eri — Fx) (4c) 


a (x. = 45 Z(zy— r) 
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11.1.2 Calculation of the partial correlation coefficients 

If there are only three variables, the partial correlation co- 
efficients are calculated most easily from formula (11.1.1,46). 
With more than three variables, Goulden (1952) recommends a 
systematie approach using the Doolittle scheme to calculate the 
bik. This requires the solution of p sets of normal equations, 
one for each value of k. 


TABLE 11.1.3 
Rainfall and temperature at Toronto, Canada (Example 11.1.3) 


2 wey “Z Q: V ,. 1 D . 21 Sg a 
1 39 31 26 39 32 51 5-7 32 76 39 38 
2 29 41 27 61 26 52 67 31 77 65 31 
3 37 29 28 70 48 53 59 31 78 65 35 
4 41 33 20 38 29 54 24 36 79 58 37 
5 34 42 30 63 35 55 48 31 80 73 26 
6 13 28 31 62 27 56 63 31 81 9.7 27 
7 2:0 41 32 56 25 57 42 32 82 80 37 
8 47 33 33 22 34 58 63 30 83 81 24 
9 42 40 34 41 29 59 58 33 84 62 25 

10 37 28 35 17 33 60 57 34 85 66 27 

11 42 34 36 39 35 61 67 29 86 69 28 

12 42 34 37 44 26 62 35 32 87 79 33 

13 47 33 38 3:0 26 6 7:2 29 88 83 26 

14 50 37 39 58 31 64 53 27 89 67 28 

15 55 33 40 54 38 65 62 35 90 54 35 

16 40 39 41 60 32 66 5-7 32 91 84 26 

17 44 30 42 4:7 30 67 25 34 92 72 38 

18 34 34 43 38 40 68 50 34 93 55 33 

1 37 40 44 69 30 69 7:5 30 94 74 31 

20 61 46 45 44 28 7 51 30 95 63 41 

21 43 33 46 54 29 72191 27 96 81 29 

22 35 25 47 60 32 72 73 29 97 73 33 

23 22 32 48 72 31 73 54 34 98 78 28 

24 38 24 49 58 29 74 43 34 99 97 25 

25 05 30 50 71 30 75 58 30 100 67 34 


11.1.3 Example 

Table 11.1.3 gives the annual mean temperature z, (in °F, with zero at 
40° F) and the annual rainfall z, (in inches) for the year x, (zero at 1850), 
at Toronto, Canada. The calculation of the correlation coefficients is shown 
in Table 11. I. 3a, using (11.1.1, 4 a—c). The values EZ(z,—Z,), E(x,—2;) 
(z,— 2,) are obtained from the formulae 


(r, -&.) = La}—(La,)*/n, 
E(v,—2;) (zy — £y) = La, zy — (La, Lz) /n. 


It is clear from the value 712.3 that temperature is strongly correlated 
with time—the mean annual temperature shows a definite rise with time. 
The other correlations are much less certain. 
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Table 11.1.3b shows the linear regression functions obtained by the 
standard Doolittle method. It is seen that the dependence of rainfall on 
temperature and time is not established—the regression coefficients are of 
the same order as their estimated standard errors. The correlation 
coefficients obtained from the regression coefficients are of course identical 
with those obtained in Table 11.1.3a. 


TABLE 11.1.3a 


Calculation of correlation coefficients for the observations 
of Table 11.1.3 


n= 100 
Ex, = 5050 Xa? = 338350 E(r—2,)! = 83325 
Zz, = 536-7 Ea = 3212-47 E(r,—4,)9— 332-0011 
Er, = 3197 Zaz = 104425 る (z。 一 る 。)* = 2216-91 
Zam = 30651-8 X(z,—2,)(x4—2,)- 3548-45 
Ex, zs = 158283 E(z,—4,) (zs —4,) = — 3165-50 
Ex, 4 = 16949-1 Elz, — Ez) (z。ー る 。) = 一 216-199 
Ti, = 3548.4515259.66 = 0-674654 
r = —3165-50/13591-3 = — 0-232906 


723 = — 216-199/857-914 — 0-252005 


Tis3 = 0:615961/0-972499 x 0-967726 = 0-654503 
713.2 = — 0-062890/0-967726 x 0-738134 = — 0-088043 
728.1 — 0-094874/0-972499 x 0-738134 = — 0-132167 


TABLE 11.1.35 
(a) Fitted regression functions for the observations of Table 11.1.3 


Us = 35-336 — (0-018828 + 0-022) a, — (0-44997 + 0-34) z, 
u, = 4532+ (0-041111 + 0-0048) 2, — (0-038821 + 0-030) zs 
u= 7.738 十 10-4200z。 一 0-411712, 


(b) Correlation coefficients calculated from regression coefficients 


mas = --4(0-041111 x 10-4200) = +0-65450 
ss = —4(0-41171 x 0-018828) = — 0-08804 
Tası = —4(0-44997 x 0-038821) = —0-13217 


11.1.4 Orthogonal functions 

The symbol z; % will be used for the function of z; and the 
q variables x, which is orthogonal to each of the z, over the n 
points of observation. Then from the relations between the 
orthogonal functions and the quantities occurring in the Doolittle 


scheme (7.2,4a—e), $5447 Eat o (la) 


Pik.a x Lx, r = La; N. a (15) 
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The last result follows because z; 。 is z; plus a linear function of 
the q variables z,, and £y is orthogonal to each of these q variables. 
From (11.1.1,1), 


77.0 28 Xx, /a. の (2) 
Ex; ,2y 
and so Tik = <a US EI. (3) 
5e {Ex} Xj 


It follows from the last equation that r is less than or equal 
to unity. 


11.1.5 Significance test for a correlation coefficient 

Significance tests for correlation coefficients can be derived by 
postulating that the variables follow a multivariate normal 
distribution—a generalization of the bivariate normal distribu- 
tion discussed in § 2.3. It can be shown that the significance of a 
value 7 can be tested by means of a t-test, using the quantity 


t= Tay 72-2". (1), 


with » —4—2 d.f., q being the number of variables held constant. 
Also if p is the true correlation coefficient, and 


— Im tanh ユ 7。 2 init? 
Sm =P 


= tanh^ p, (2) 
then z—Z is distributed approximately normally about a mean 
value p/2(n—q—1) with variance 1/(n—q—3). This enables the 
significance of the departure of an observed value r from the 
value p to be tested. 

Proofs of these results are too long to be given here. They will 
be found in Chs. 14 and 15 of Kendall’s book. 


11.1.5.1 Example 


For the correlation coefficients of Table 11.1.3a, v is 97. Hence (11.1.5,1) 
gives 


I 0-655 

2 0-088 
(ii) for 130, t= ー な 996 9-85 = —0:87; 
aa 0-132 
(iii) for To3.1» $ = 70-991 9-85 ニー 1:31. 


The significance of the last two coefficients is doubtful. 
Tables 13 and 15 of the Biometrika Tables give the significance levels of 
7 directly. 
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11.1.6 Serial correlation of residuals 


The estimate of the serial correlation coefficient for the residuals 
%; is given by 


R=] 
> (v — 8;) (v4.1 — 91,3) 
9 n-l (la) 
— = — 6)" > > D (Visi — Pis)? J 
121 
P n P 1—1 
Since = v; is zero, ö, = > v;/(n—1) is very small, and 
=1 i=1 
n—1 
2 Uie 
pp, (15) 
る の 
i=l 


If the deviations of the observations from the ‘true’ function are 
random, H(v;v;,,) is of the order of - / ($ 2.6.1) and r will be 
small. Hence the serial correlation coefficient will test the hypo- 
thesis that the deviations are random. If they are not random 
the usual calculations of standard deviation will not be valid, 
and the values obtained for the standard deviations can only be 
regarded as at best rough approximations. 
Unfortunately, the significance of a value r is not easily tested. 
Durbin and Watson (1951) give limits for the quantity 
(Av)? T(v. 1 5 
dm - 855 = ( 9 ^ n sk = 2(1 一 ヶ ) (2) 
in terms of the number n of observations and the number p of 
coefficients estimated. Quenouille (1952) has put this test in the 
form of a test for r considered as an ordinary correlation coefficient 
based on vidis or n— N, observations. If 


N MU (n + N, — 2), 5 -N 2, も も 。 
(3) 


there is no evidence of serial correlation if the larger value t, is 
not significant, while there is evidence of serial correlation if the 
smaller value f, is significant. If the value of ¢ at the particular 
level of significance lies between ti and z, the test is inconclusive. 
Values of N, and N, for two levels of significance are given in 
Table 11.1.6. 

If the deviations are serially correlated, it is possible that a 
different form of analysis is desirable. In economies considerable 
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use has been made of regressions of the dependent variable on the 
independent, variables and one or more previous values of the 
dependent variable. This work is described in monographs edited 
by Koopmans (1950) and Hood (1953). 


TABLE 11.1.6 


Values of N, and N, for use in (11.1.6,3) (p is the number 
of coefficients determined) 


5% level 2% level 
Dp NI Na N Na 
1 20 —1 16 — 1 
2 35 5 30 5 
3 60 10 50 10 
4 100 15 75 15 


11.1.6. 1 Example 


For the example of $ 7.1.1 the value of £w; v;+ is found to be — 0-632975, 
while Xv} is 3-720544. Hence r is — 0-170, and there is certainly no evidence 
of positive correlation between successive residuals. 

For the example of $7.6.2.1 the residuals are given in Table 7.6.2.3a. 
From these values, Lu, vi is 3963-93 and Xv} 7515-44. Hence r is 0-527, 
and so there is positive correlation between the residuals and the deviations 
from the fitted curve are not random. The formulae (11.1.6,3) give at the 
5% level for p = 3 


t, = (0-527/0-850) /(62+ 60 — 2) = 6-8, 
t, = (0-527/0-850) /(62 — 10 —2) = 4-4. 


11.2 TWO VARIABLES, FUNCTIONALLY RELATED 
AND SUBJECT TO ERROR 
If the variables Y, X, are connected by the equation 
F(Y,X; B.) = O, (1) 


then, since the adjusted point y;—v,;2;— v,; lies on a curve of 
the same form, 


0 の 
F (y; vit, 2; — vet; by) = 0 = F t; bt) — % Vyi — 6) Uri 
9m „, 
+> (元 Dj (2a) 
where b, = b9 +b, (2b) 
is an estimate of B. Now the least-squares principle requires that 
Lwy, v2; + Dw, v2; 

should be a minimum, and so the least-squares conditions are 

LW vt AV Lit vrt Av = 0. (3a) 
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The small variations Avr, Avr, are not independent, for, from 
(2a), for a given set of values On, 


の oF 
Us à Ao; + (=). Av. = 0. (3b) 


On substituting this expression for Av,; in (3a) and setting the 
coefficient of A equal to zero, 


1 / の 7 1 EF 
der テー ld Wa (5); 9 


Using these results, it is easy to show that 


IC v Ni * 52 , 2. ia 
q &y ý yi éx ¿ wt yi Cyt Wri Uri» (4a) 

1 ] (OF? 1 /éF\2 
where — — (s T 5 4b 
Wi e // Wri Xem], (49) 

Hence, from (2a), 
Ew, 2; + lw, vat = Ewy, — Eb, z), (5a) 
where y; = F (Yi t; bf) (55) 
‘OF 

and m, = 一 (5. š 5c 
ki ab A ( ) 


Equation (5a) corresponds to the condition that the sum of 
the squares of the residuals should be a minimum for a given set 
of values b,. To find the values b, which minimize the sum of 
the squares of the residuals, (5a) is differentiated with respect to 
bL. This gives rise to the familiar form 

Ew,(y; bi zk) zy = 0. (6) 

It will be observed that, except for the weights, these equations 
are identical in form with the equations of § 10.2.3.1, where X 
was free from error. For instance, if Y were & linear function 
of X, the straight line obtained from (6) would be the regression 
line and not the line of functional relationship. It would only be 
possible to differentiate between the regression and functional 
relationship curves if higher-order differential coefficients were 
retained in the expansion (2a). 


11.2.1 Example 

In the example of $10.2.3.2, it was assumed that the time intervals t 
were free from error. If it is now assumed that the standard error of t is 
5% of t, then, from (11. 2, 46), 


oj = o$ + (Bre)? oj, = o$ + (0-052)? z$°. 
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The approximation for À is 0-04, while the approximations for æg are given 
in Table 10.2.3.1. Taking as in Example 10.2.3.2 a value 1-2 for c, 


Jwi = 1-2/(03,+4 x 1075 252)5. 


The values 44»; are caleulated in Table 11.2.1, and the normal equations are 
formed and solved in Table 11.2. 14. From this table 


b; = (- 0-304 + 0-095) x 10-?, 
and so À = 00370 + 0-0010. 


TABLE 11.2.1 


Calculation of weights when both variables are subject to error 
(Example 11.2.1) 


ay 22 (07 ＋ 4 , 10 9) Jw 
0-06 699 0-0064 15 
0-10 5685 0-0327 7 
0-12 10262 0-0554 5 
0-18 22338 0-1218 3 
0-26 42238 0-2366 2 
0-30 56473 0-3159 2 
0-40 61246 0-4050 2 
0:45 60113 0-4430 2 
0:50 46686 0-4367 2 
0:60 35827 0-5033 2 
0:60 22834 0-4513 2 
0-65 12224 0-4714 2 
0-65 3102 0-4349 2 
0-65 758 0-4255 2 
0-65 184 0-4232 2 


11.2.2 Geometrical interpretation 
The slope of the curve F., a) at a particular point can be 
found from the condition that 


oF oF 


is zero along the curve. The slope is then 


(50/5) a) 


The slope of the line joining the observed point to the adjusted 
point on the least-squares curve is given by 


tan 6 = v,/v,. (2) 


11.2 TWO VARIABLES 
Hence, from (11.2,3c), 


^v [dy 
tam 0, = — 1/4 (32) ; 
, Wri dz, (3) 
Thus the least-squares principle effectively minimizes the sum 
of the squares of the deviations in the directions 8;. If the ratio 
w,;/Wz, is constant for all the points of observation and the 


observations are plotted on a scale such that wy;/w,; is unity, 
the deviations are all normal to the curve 


TABLE 11.2.1a 


The normal equations for Example 11.2.1 


人 ĩ—⅛ 2 
Factor removed: , 102 


Jw {wey Jwr ND 2 
.... . . qip asss 
15 — 14-4003 3-9658 18-6081 23-1736 
" — 6-1664 5-2779 6-7539 12-8654 
5 — 4:1780 5・0650 2-6574 8-5444 
3 — 2-2260 4-4838 0-9128 6-1706 
2 — 1-2082 4:1104 — 0-2575 4-6447 
2 — 0-9619 4:7528 — 0-9087 4-8822 
2 — 0-7970 4.9496 ー 1-4599 4-6927 
2 — 0-6220 4-9036 — 1:2065 5-0751 
2 — 0-3942 4.3214 — 1:3161 4-6111 
2 — 0-2909 3-7856 — 0-7462 4.7485 
2 — 0-1904 3.0222 — 0-9003 3-9315 
2 — 0-1145 2.2112 + 0-0926 4-1893 
2 — 0-0430 1-1140 — 1-8195 1-2515 
2 — 0-0171 0-5508 — 1-8972 0-6365 
2 — 0-0071 0-2710 — 2-0678 0-1961 
352 — 296-0299 203-1939 317-4500 576-6140 
271-5026 — 141-0222 — 318-6228 — 484-1723 
226-0170 93-8149 382-0036 
418-5443 511-1865 
418-5443 
352  — 296-0299 203-1939 317-4500 576-6140 286-2913 
1 — 0-840994 0-577255 0-901847 1.638108 132-2530 
, 108 
22-5432 29-8627 — 51-6493 0-7566 118-3349 
1 1-324686 — 2-291123 0-033563 13-9181 
563 
69-1636 — 21-0156 48-1480 6-3857 
1 — 0-303853 0-696147 7-5324 
147 
— 0-511065 — 1-888613 — 0-303853 8 = 4(7-5324/12) = 0-792 
0-488935 — 0-888613 0-696147 s(b;) = s/469-16 = 0-095 


25 
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11.3 GENERAL LEAST-SQUARES THEORY FOR 
FUNCTIONALLY RELATED VARIABLES 


In earlier discussions the ‘true’ values were supposed to satisfy 
equations of the form 


each observed coordinate appearing in only one equation. In the 
more general case, the observed values Y; may appear in any 
number of the conditional equations. There will, in general, be 
no obvious division of observed quantities into dependent vari- 
ables Y and independent variables X, and so each variable will 
be represented by the general symbol Y. The conditions which 
are satisfied by the » values Y; will be written 


F(Y; B) = o, q=1tor. (1) 
If y; are the observed values, v; the residuals, and 
b; = b? +b; 
the estimated values of the p parameters B;, then 
F9, — vi; b +b) = 0, (2a) 
a Taylor's expansion gives 
Fat vt = Hat; b?) + > Fa; b. (2c) 


The least-squares principle states that the parameters and 
adjusted values are to be chosen to minimize L u. This requires 
that, for small variations Apt, 


From (2c), the variations Av; are not independent, but are con- 
nected by the r equations 


i 3 


Introducing r Lagrangian multipliers À,, as in $ 8.3, these equa- 
tions can be combined to give 


> (v 5 XX, 750 An- ZAF Ab = 0, (4) 
i q q 


where the coefficients of Av; and Ab; can now be equated to zero. 
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Hence 
W; V; = EAXF (m equations), (5a) 
xx Fo = 0 (p equations). (5b) 
Substitution for v, in (2c) gives 
DU EN Jer Fer E Fob = F(Y: b9). (5c) 
If the quantity Lis is defined by the equation 
La = > Fat trt Fat, (6) 
then (5c) and (50) become 
LL > Fb; = F.; b!) (r equations), (7a) 
E Fid =0 (p equations). (7b) 


These r+p equations are the general normal equations. They 
form a symmetrical set which may be solved to give the p para- 
meters bj, and the r multipliers À, which determine the residuals 
and hence the adjusted values. 


11.3.1 Example 


f In Table 11.3.1a are listed the results of the measurements of the three 
sides a, b, c, and the three angles 4, B, C, of a triangular area. These values 
are to be adjusted so that they satisfy the three conditional equations 


F, = A+ B+ C-—180° = 0, 
F, = (sin A/a) — (sin Bjb) = O, 
F, = (sin A/a) — (sin C/c) = O, 


connecting the sides and angles of a triangle. Factors 103 have been 
removed from the length measurements (originally in feet) to bring them 
to the order of unity. In this example there are no parameters B; to be 
estimated, and there will be just + = 3 normal equations (11.3,7a). 

In section (ii) of the table the weights are allotted, c being chosen so 
that the weights of the angles are unity. The actual values F, are calculated 
in section (iii), and the differential coefficients in section (iv). The normal 
equations are found by intermultiplying these columns (11.3,6). The 
resulting equations are given in Table 11.3.la. A factor 10-? is removed from 
F; to simplify the calculations, and the equations are solved by the 
abbreviated Doolittle method. 

The solutions A, are entered in section (v) of Table 11.3.1. When the A, 
are multiplied by the rows of section (iv) the values Woiti are obtained 
(11.3,5a). The adjusted values u; = y;—v; are calculated in section (vi). 
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TABLE 11.3.1 


Adjustment of observations on a, triangular area (Example 11.3.1) 
CS 


(i) Observations 


Factors removed: a, b, e, 108. 


A 90° 17’ +2’ a 1-0000 + 0-0007 
B 44° 28’+ 2’ 5 0:6997 + 0:0005 >unit 1000 feet 
C 45° 18’ + 2’ c 0-7107 + 0-0005 


(ii) Weights 

2' = 0-58 x 10-3 radians o = 0-58 x 107? 
Vwa = Jwg = Jwc = 1 
Jwa = 0:83 Jw, = Jw, = 1:16 


(iii) Values F; 

F, = A+B+C—180° = 0-8727 x 10-3 (radians) 
F, = (sin A/a) — (sin B/b) = 1.1473 x 107? 
F, = 


2 = (sin A/a) - (sin C/c) = — 0-1522 x 107? 


(iv) Differential coefficients 


64 BE op = Foo Foe = Fo = Foe = 0 
14 = cos 4 / ig = cos B/b 10 = 0 
Fia = —sin A/a? Fi, = sin B/: Fi. = 0 
24 cos A/ sg = 0 20 = —cos Ofc 
Foq = sin A/a? k= 0 Fi. = sin C/c? 
3 Foil dw, Fr lt, T J, 
A L — 0-0049 — 0-0049 
B 1 — 1-0199 0 
C 1 0 — 0-9897 
a 0 — 1-2048 — 1:2048 
b 0 1.2335 0 
C 0 0 1-2132 


(v) Solution of normal equations 
A; +0-239517 x 10-3 — 0-268853 x 10-3 +0-122032 x 10-3 


(vi) Fitted values 


i Jw, v, の 』 UM 

A 4- 0-240 x 10-3 + 0-240 x 10-3 90° 16-2’ 
B 4- 0-514 x 10-3 4- 0-514 x 10-3 ` 44? 26.2/ 
0 4- 0-119 x 10-3 4- 0-119 x 10-3 45° 17-6' 
a 4- 0-177 x 10-3 + 0-213 x 10-3 999-79 ft 
b — 0-332 x 10-3 — 0-286 x 10 699-99 ft 
c 十 0.148 x 10-3 4- 0-128 x 10-5 710-57 ft 
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TABLE 11.3.1« 


Solutions of normal equations for Example 11.3.1 


Factor removed: F;, 10-3 
3 — 1:0248 ー 0-9946 0-8727 1:853300 
4-013285 1-451567 — 1-1473 3-292752 
3-902927 — 0:1522 4-207694 


1 | 3 — 1.024800 — 0-994600 0.872700 1-853300 
0-333333 1 —0-341600 — 0-331533 0-290900 0-617767 
0-341600 1 3-663213 1111812  — 0-849186 3-925839 
0-093251 0-272984 1 0.303507 — 0-231815 1-071692 


0-227855 — 0-303507 1 3-235742 0.394863 3:630604 

0-070418 — 0093798 0-309048 1 0.122032 1-122031 
0-239517 — 0-268853 0-122032 
1:239517 0-731148 1:122031 

Inverse matrix 

0-381233 

0-071879 0-301452 

0-070418  — 0-093798 0-309048 


11.3.2 Summary of standard deviation formulae 

The derivation of the formulae for the standard deviations of 
the parameters and fitted values is quite involved, and it will be 
convenient to first list the formulae and defer the proofs till 
§ 11.3.4. The symbol xi will be used for an element of the matrix 
which is the inverse of the matrix 


Le. Fa 
4 0 


ts 


occurring in the normal equations. Then for the residuals 


Ero vf = (r—p) os, (1) 
” P 

vare, = Ev] = u Y, Xu Fi, Fi on. (2) 
S=1 [= 


For the fitted value w, = Y; — Vi 
r 
varu = arif Hur. N xu Fa fi es, (3) 
5,11 


the term in brackets giving the change in variance brought about 
by the least-squares adjustment of the observations. For the 
parameters, 


var by = — x,44, raj OŠ. (4) 
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The sum Nuss u can be obtained without finding the individual 
residuals. From (11.3,5a), 


Ew kaa Eu! EA DA F; Tat: 
i t q 8 


and so, from (11.3,5c) and (11.3,55), 
Xw-XAE(). (5) 
t q 


11.3.2.1 Example 

The standard deviations of the fitted values obtained in Example 11.3.1 
will now be calculated, using (11.3.2,3). The values y;; from Table 11. 3. 14 
are entered in Table 11.3.2, together with the products r? Fg, Fi, 
calculated from Table 11.3.1(iv). The quantities 


S, = L= RF FR 


are caleulated, and checked by the formula 
XS, = n—r(+p). 


This latter formula follows from (11.3.3,7c). Here there are no parameters 
and p is zero. Finally the standard deviations of the fitted values are 
found from 


olu] = c S Aw. 
TABLE 11.3.2 
Standard deviations of adjusted values 


S. = 1- Xx» Fg Fry fe, 


Xoo 2X01 2X02 xu 2X12 X22 0 
0:3812 0:1438 0-1408 0.3015  —0-1876 0-3090 0-58 x 10-3 


Fii Py fto, S, o[u] 
1 — 0:0049 0 0 0 0.6202 1:6 min 
1 — 1-0199 0 1-0402 0 0 0.4518 1-3 min 
1 0 — 0-9897 0 0 0.9795 | 0-4555 1-3 min. 
0 0 0 1-4515 1-4515 1-4515 |0-3862 0-43 ft. 
0 0 0 1-5215 0 0 0.5413 0-37 ft. 
0 0 0 0 . 0.5452 0:37 ft. 
3-0002 


11.3.2.2 The residuals. The value Nu, u:, obtained either by 
direct summation from Table 11.3.1(vi) or from XÀ; Ej, is 


Ew; v? = 2 ん F, = 0:499 x 10-8, 
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Thus the estimate s of c, from (11.3.2,1), is 0-408 x 10-8, based on 


3d.f. This agrees well with the value 0-58 x 10-3, and so no 


doubt is cast on the standard deviations of the estimates given 
in Table 11.3.1 (i). 


11.3.3 The general case in matrix notation 


The symbols which will be used for the various matrices are 
defined in Table 11.3.3. 


TABLE 11.3.3 


Matriz symbols 
Symbol Order Element 
f rx 1 T, (yi 9) 
y n * 1 Vi 
v nxi v; 
w nxn N., = w; (diagonal 
matrix) 
b pxl b; 
J pr Fa, = 9 の 7。/96。 
F n Fg: = 8FQ0y; 
L rXT Le 
A 1 * 1 A. 
L JT 
中 p+rxp+r [ J O 
x P+rxp+r [$7] 
The matrix 中 can be written in the form 
rr rp 
o = + " 中 " (1a) 
gv 0 
where chr = L., qr =, (15) 


the superscripts indicating the order of the sub- matrices. The 
inverse can be written similarly as 


sito X" ‘ 
When two matrices, partitioned in the same way, are multiplied 


together, the product is obtained by formally treating each sub- 
matrix as a single element. Thus 


b” yx" + o? x? ch y? 十 bP yP? 
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But this product is I, and so 


$r x” +H? I= x” Ó” + x u; (4a) 

rry? = 1 = x” rr; (4t) 

QT x7? c yr? = O = A Hrs x?? or; (4c) 

zr y” = O = x” . (4d) 

The following formulae are required in the subsequent discussion: 
x" br yr = yr; (5a) 

X" "x = O = Au x”; (5b) 

x” br x"? = 一 Xv. (Sc) 


Equation (5a) is proved by multiplying (4a) by x” and using (4d). 
It can be shown that y’ is a singular matrix, and so it cannot be 
divided out of (5a). Equation (5b) is established by multiplying 
(4c) by x” and using (4d), (5c) by multiplying (4c) by x?” and 
using (45). 

The sum of the diagonal elements of the product 中 ”X is, 
from (4a), 
a で r 4 = Í d rAr ] 
0. Era] =r- È [2 ar am), 


t=1 u=w=1U=1 


p 
From (45), the last term is Y J uu; and so 
u=1 


S- Y G = r>. (6) 
In the present, discussion, from (11.3,6), 
$” = L = FT W- F, (7a) 
and >r = J. (7b) 
Hence (6) can be written 
E È Xun Fy Pig = r—p. (Te) 


11.3.3.1 The normal equations. In the notation of this section 
the normal equations (11.3,7a, b) are 


pià, —b} = (f, 0}, (1a) 
or (^, —b) = Aff. 0). (15) 


The matrix (A, —b} is the column vector of order r+p whose 
elements are M, —bj. Equation (1b) can be written in the form 


A= X7f b= —xzrf. (1c) 
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The elements of f are 


Felt: bj) = FY; Bj) (- T.) Fi, (%- B;) F. 


j qi? 
where Y, and B, are the true values, and so 
f = FTC y- Y) -- J7(b? — B). (2) 
Hence from (11.3.3,4d), 


À = x”F7(y — V), (3a) 
and from (11.3.3,46), 


b = — x?" FT y- T) - (be- B). (30) 
If the prefix Š is used to denote deviations from the true value, 
so that 
dy y- , 5b=b°+b-B, 
then (3a) and (3b) become 
A= X" FT Sy, Sb = -n FT sy. (4) 


The normal equations for the parameters b; can be put in the 
same form as those in the discussion of correlated variables in 
§ 8.3.1. The set of equations (11.3,7a) can be written 


A = L-1(f +J7 b). 
On multiplying by J and using (11.3,7b), this vanishes, and so 
JL-!J7b = —JL-f. (5a) 


This corresponds to (8.3.1,3a). The matrix L-! is the weight matrix 
for the quantities f, since for a given b?, from (2), 


E(ff7) = Fr W— Fo? = Los. (5b) 


11.3.4 Covariance matrix for (A, b) 
The covariance matrix for (A, b) is 


EA, 8b) (A, 8b)7 = 到 ioa ーー | 
Now E(AX7) = x” ET E(6y Sy”) Fx", 
and E(6y 5y7) = W~ o?. (1) 
Hence EAT) = Y X = xT o. (2a) 
Similarly, E(A&b7) = — x” pr XPP = 0 (2b) 
and E(&b &b7) = x?" brr y"? o? = — xP? o°. (2c) 


It will be observed that A, and b, are independent, and that 
(11.3.2,4) has been established. 
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11.3.4.1 The residuals. Since, from (11.3,5a), 
y = WFA, (1) 
the covariance matrix for the v; is 
covy = E(W-1 Fa) (W- Fa)? = W- Fy"E7W-!o?. (2a) 
Since W is a diagonal matrix, 


Evi = > 2 we) Ja xl FZ, tr o, (2b) 


t=] usl 


which is (11.3.2,2). Also 


EXw,v?- > > W Fat ur Tu o = x X x G os. 


t=] u=1 1 t=lu=1 
Hence, using (11.3.3,6), 
EXw,vj = (r) o°, (3) 
which is (11.3.2,1). 
The residuals v, are statistically independent of both the 
adjusted values u; and the parameters b, For 


E(v6y7) = WA Fy" FT E(5y Sy”), 


and so from (2a) E(v6y7) = E(vv?), 
or COV (Vhs Yi) = COV (Vh, v;). (4a) 
Hence COV (Vp, u:) = COV (v, y; b,) = O, (4b) 


which establishes the independence of v, and u,. The independence 
of v, and b; follows from (11. 3. 4, 20). 


11.3.4.2 Covariance matrix for {u,b}. The adjusted values 
% = y — V; will form a vector 


u=y-W "FA = y- W Fy" FT ôy, (1) 
and so the covariance matrix for {u, b} is 
cov {u, b) = E(8y —W-1 Fy” FT Sy, — x2r FT Sy} 
x {8y -W Fy" FT ôy, — yx?" FT ST. 


t2 
— 


Now 
W- FF? W-1Fxr F7 W- = WAT) br y> FT W- 
= W Fy FT W~ 
and x?" ET WI Fy?” FT W- = xz $r x” F7w- = 0 
Q7 eo の | à 


r D (3a) 


Hence cov ſu, b) = wo? = | 
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where e)” = WW- Fy’ FT WI, (36) 
Pr = —yPr FT WI, (3c) 
GPP = ー X??. (3d) 


Formula (11.3.2,3) follows from (3b). 


11.3.5 Variance of a function 


If G(Y;; B;) is some function, the deviation of the value G(u,; b;) 
obtained by using the adjusted values and estimated parameters is 


5G = gTí8u, db}, (La) 
where g = (eGJ0Y,, G/B}. (15) 
Hence varG = EC) = Lg? {Su, 5b) (du, 8b)7 g, 
or var G = gT wgo. (2) 


11.3.5.1 Special cases. If both adjusted values and parameters 
are present in the function G, the evaluation of the standard 
deviation of G is very complicated. If only one of these types is 
present, the calculation is not quite so difficult. 

If adjusted values alone are present in the function G, g is a 
vector of » elements, and 


var G g7(W-1 —W- Fx” FT Wi] gos, 
which reduces to 
varG = zurig- È Xxq(Zwsea)(zwsra)e oo 
q^1s-— t t 


On the other hand, if parameters alone are present in the func- 
tion G, g is a, vector of p elements, and 


var G = —g? xP? gos, 
p 2 
or varG — — p DE g; gi. 02. (2) 


In either case, it is possible to compute var G without inverting 
the matrix by adding an extra column to the right-hand side of 
the Doolittle scheme. In the first case, a column of values 


Dur. Fat 
1 
is added. The solution using these values is 
r 
K, sai; È Xas È wil gi Fu (3a) 
q= t 


and so var G = (zuz? 97 LK, > weg; FQ O2. (3b) 
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Similarly, in the second case a column of values 9% is added. 
The solution of the Doolittle scheme using these values is 


p 
K, = X» XIE ge (3c) 
k=1 
and var @ = A, K, o°. (3d) 
2 


However, it is usually simpler to eomplete the inversion of the 
matrix and use (1) and (2), especially if the variances of several 
functions are required. 


11.3.5.2 Example 

The area of the triangle discussed in $11.3.1 can be evaluated from 
the formula ibe sin A. The standard deviation can be calculated using 
(11.3.5.1,1), the steps being shown in Table 11.3.5. 


TABLE 11.3.5 


Evaluation of the standard deviation of a function 
of the adjusted values 


(a) Area 
G = besin A = 0-248693 


(b) Differential coefficients 


ga = tbc cos A 一 0.0012 galwa — 0-0012 
98 = go = O = g. 
の = osin A 0-3553 95 / t 0-3063 
g. = jbsinA 0-3500 g/ V 0-3017 
(e) Variance 
2g; Fw, 
j 0 1 2 Xgtju, 


—0-0012  0:3778 0-3660 0-1848 


(Eg; F$ ao) (Eg, Fiil w) 
J. k 0,0 0,1 0, 2 ‘ 1 1,2 2,2 
0 — 0:0005 — 0-0004 0:1427 0-1383 0-1340 


Egi[/w,;— Eyar (Eg, Fi pi) (Tg. Py ao) = 01264 
o[G] = 0-356 o = 0-206 x 10-? 
Area 248,700 + 200 square feet 


The alternative method, using (11.3.5.1,3a—b), is illustrated in Table 
11.3.5.1. The values Zg, F;,/w, are evaluated as in Table 11.3.5, and these 
values are then treated as an extra column of Table 11.3.la. The solutions 
using this column are multiplied by the values Dwy! Fg, g, and the sum 
subtracted from Xw;! gj to give var G/o*. 
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TABLE 11.3.5.1 


Evaluation of standard deviation using (11.3.5.1,3a—b) 


一 0.0012 
0-3778 
0-3660 
— 0-001200 
— 0-000400 
0-377390 
0-103022 
0-251062 
* 0-077590 
0-052472 0-079473 0-077590 
LK, To. F 0-058360 


D/ w. EK; Tg. F.. 0.1264 


114 NOTES AND REFERENCES 


(11.1) Multiple correlation and regression are treated adequately in most 
books on statistics; see Kendall (1948) and Quenouille (1952). References 
on serial correlation include: Durbin and Watson (1950), Hannan (1955a, 
19555), Daniels (1956), and Watson (1955). 

(11.2) This treatment is due to Deming (1943). 

(11.3) Discussions of this topic are given in many older books on least- 
squares; Wright (1884), Leland (1921), etc. À good account (without 
mathematical proofs) is given by Deming (1943). An interesting reference 
is Benthem (1954). 
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CHAPTER 12 


FURTHER ILLUSTRATIVE EXAMPLES 


In this final chapter à number of examples illustrating the types 
of problem usually encountered in practice will be discussed. 
There is in the first section a guide to the more commonly used 
calculating schemes to help the reader identify readily the 
method best suited to his particular problem. The five examples 
which follow illustrate the five commonest types of problem— 
the straight line, the polynomial, the polynomial with equally- 
spaced observations, the linear function, and the non-linear 
function. 


121 GUIDE TO THE MORE IMPORTANT 
CALCULATING SCHEMES 


12.1.1 The straight line 

Observations y; v; Fitted line u(x) = bo + b, z. 

Estimates of standard deviation: s, standard deviation of an 
observation; s(b,), standard deviation of b; s[u(z)], standard 
deviation of fitted value. 


(a) Standard calculating scheme 
Section 6.1.4, Tables 6.1.4 and 6.1.4a. 
s[u(x)], Table 6.1.5, with o, (k) from Table 6.7a. 


_ (b) Equally-spaced observations 

Variable e = (Y- F/ Aw, $6.3; $ mean, Az interval between 
neighbouring z; values. Xe? in Table 6.76. 

(e) = a +a, e; Table 6.3.3 (n even), Table 6.3.3a (n odd). 

s[u(e)] = sn p, (E), k = 2|e|[n, p, (k) from Table 6.7a. 

u(x) = b, 4- 5,2; b, = a,/Ax, b, = a— b, Z. 

(c) Special methods 

Straight line passing through the origin, $ 6.1.6. 

Calculation of slope from differences of successive equally- 
spaced observations, Table 6.3.4 (W, from Table 6.7c). 

Calculation of slope by double summation of equally-spaced 
observations, $ 6.3.6. 

(d) Both variables subject to error 

If the regression line only is required (e.g. for estimation or 
prediction of the value y corresponding to an observed z), the 
presence of error in the variable z is immaterial. 
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If the line giving the functional relation between the 'true' 
variables is required, refer to Table 6.5.3. The estimate of the 
error-free line lies between the two regression lines, but a more 


exact estimate can only be made if one of the three quantities c, 


(standard error of z), o (standard error of y), or k = (eslo.,)*, 
is known. 


12.1.2 Polynomials 
Observations y;, z;. 


Fitted polynomial of degree p, u,(x) = 5 b, xl. 
j=0 


(a) Standard calculating scheme 


(1) Calculation of normal equations, §§ 7.1.1 and 7.1.1.1 


in = > (w) xiz, NM. = 2 Go) Tİ Yi 


27 = P ai eu C; = 2: (10) zi Zi. 


i 


Check formula: |. C; = £ j+ W. 
k 


In many problems the weights w; are taken as unity, and the 
symbol w; omitted from the equations. 


(2) Solution of normal equations. 


(i) Gauss-Doolittle scheme (simplest), Table 7.1.8; abbrevi- 
ated Doolittle scheme, Table 7.1.8.1. 
Check formulae: 


2 2 
€; = x ay + G;, > 555 Pir = Mu 
k=j j-0 


(ii) Square root scheme, Table 7.1.8.2, $ 7.1.5. 
Check formulae: 


p p 
の = 之 Sig + mp pu Pir = My- 


(iii) If polynomials of different degrees, standard deviations of 
fitted values, or elements xj, of the inverse matrix, are 
required, the corresponding schemes of Tables 7.2.3, 
7.2.3a, and 7.2.4 should be used. 

Additional check formulae: 


る Poj = 0, Eryg4o-9; cher xj = 1. 
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(3) Residuals v; = y; — w, (z). 
In the Doolittle scheme, 


z 2 
E(w) vpi = (wy) 91 — M à; A, = X(W;) 953, — Up Mp- 


Individual residuals, Table 7.2.5. 
Check formulae: 


> [E = > by (X 20 LW; i Ly; re >u, (:). 
i j i 


(4) Estimated standard deviations: 
of bpp $ 8.1.2; 
of «, (z), Table 8.1.2 (approximate values, § 8.5.6). 


(5) Restoration of powers of ten. If 10” is removed from y; 
and 10% from z; to bring them to the order of unity, powers of 
ten are restored by multiplying b,; by 1071079, See Table 7.1.7. 


(b) Equally-spaced. observations 

Variable z replaced by e = (z —z)/Az. 

(1) Fitting by power moments. 

(i) Calculation of moments: Table 7.6.2.1 (n even) or Table 
7.6.2.2 (n odd). 

(ii) Caleulation of coefficients: Table 7.6.2.1a (p < 3) or Table 
7.6.2.2a (p < 5); S and 5% from Table 7.100. 

(iii) Residuals: Lv. = Ly? — Za; M; = Iw? 4 ,—a, My. 
Individual residuals, Table 7.6.2.3a (n even), Table 
7.6.2.3b (n odd). 

(2) Fitting by orthogonal moments. Most useful when the 

degree of the polynomial is uncertain. 

(i) Calculation of coefficients, $ 7.6.3.2, Table 7.6.3. 

(ii) Residuals: Typ, = Ey? Taf. M; = X2 ,,—0a,4,. Indi- 
vidual fitted values and residuals, § 7.6.3.3, Table 7.6.3.1. 

(3) Estimated standard deviations: 

of an observation, sp = (Zs2;/(n — p — I); 

of a fitted value, $ 8.4.2. 
(4) Return to the original variable z, $ 7.4, Table 12.4f. 
(c) Both, variables subject to error 


The only practical procedure is to ignore the error in the inde- 
pendent variable, except perhaps in the allotting of the weights. 
See § 11.2. 
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12.1.3 Other functions 
(a) Linear functions 
Treatment similar to polynomial fitting, with 2/ replaced by 
the variable z;: 
(i) Formation of normal equations, Tables 10.1.1 and 12.5a. 
(ii) Solution of normal equations, Tables 12.50 (Doolittle) and 
10.1.2 (square root). 
(ii) Restoration of powers of ten. If 10” is removed from Vi 
and 10? from z; to bring them to the order of unity, powers 
of ten are restored by multiplying bp; by 107 10-4. 
(b) Changes of variable 
For the simple exponential, see § 10.2.2. 
Note that a change to a new variable must usually be accom- 
panied by a change in the weights of the observations. 
(c) Linearization 
The fitted value is expressed as a linear function in the form 
(b) = w(b2) + Eb; z$, 
where the x; are the differential coefficients of the non-linear 
function with respect to the parameters b; which are to be esti- 
mated. The values z; and ue) are found from approximate 
values b} of b, obtained by any method appropriate to the 
particular problem. The corrections b; to the b} are found by 
the usual least-squares methods. 
Examples are given in $$ 10.2.3.2, 12.3.1, and 12.6. 


12.2 THE FITTING OF A STRAIGHT LINE— 
VARIATION OF COSMIC RAY INTENSITY 
WITH ATMOSPHERIC PRESSURE 


The number of cosmic rays reaching the earth’s surface depends 
on the atmospheric pressure, since the larger the pressure the 
greater the number of air molecules and so the greater the proba- 
bility of absorption. Usually it is the rate of arrival of particles 
from outside the earth which is of interest, and so a correction 
must be made to take account of the variation of absorption 
with pressure. The corrected number of counts N, will be given 


by the formula N- N, = k(B,— B,), 
where N; is the observed number, B, the atmospheric pressure, 
and B, the standard pressure. 


The factor kis clearly the slope of the regression line of Ni on B;, 
and it can be determined from a series of observations of these 
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two quantities. Table 12.2 gives the counts in successive hourly 
intervals and the atmospheric pressures in an experiment quoted 
by Janossy (Cosmic Rays, Oxford University Press, 1948, p. 382). 
The calculating scheme of $ 6.1.4 can be used, the independent 
variable z, being identified with B. 700 and the dependent vari- 
able y; with N;— 3000. The subtraction of the numbers 700 and 
3000 simplifies the caleulations while leaving the slope of the 
regression line unaltered. 


TABLE 12.2 


Cosmic-ray counts N, (on a scale-of-eight recorder) and atmospheric 
pressure B, (mm. of Hg) in successive hourly intervals 


N, B, N, B, N; B; 


3454 757-0 3388 752-5 3530 741-7 
3420 756-6 3455 751-6 3538 740-5 
3412 756-5 3491 750-0 3538 738-7 
3407 756-2 3439 748-8 3539 737-7 
3387 755-5 3486 746-9 3564 736-8 
3414 754-9 3476 745-6 3590 736-8 
3388 754-2 3490 144-5 3578 7367 ` 
3438 753 · 5 3530 743-5 3590 730-5 


SUM. 83542 17933-2 


The detailed calculations are set out in Table 12.2a. The slope ん 
is the quantity b, in this Table, and its standard deviation is s(b,): 
The value obtained for the variation in counts with barometric 


pressure is 
k = — 8:34 + 0-65 counts/mm. Hg 


It is very desirable to evaluate the fitted values u, = bo +b; z; 
and the residuals v; = y; —w;. Examination of the residuals may 
show a systematic departure of the observations from a straight 
line, while the agreement of Xv? with the value found in Table 
12.2a provides a check on the arithmetical calculations. In the 
present example the fitted values and residuals are evaluated in 
Table 12.26. 

If the only factor causing the readings to vary was the atmo- 
spheric pressure, the residual variation should be of the Poisson 
type (Ch. 4). The average number of counts is 3000 + Zy/n = 3481, 
and, since à scale-of-eight recorder was used, the average number 
of particles counted is 8 x 3481 = 27848. Hence the standard 
deviation should be the square root of this, which is 166-8, and 
the standard deviation of N, 166:8/8 = 20-8. This is so close to 
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the value s obtained in Table 12.24 that it is probable that the 
residual variation is largely random. 


TABLE 12.2a 
Calculation of slope of regression line; y is N — 3000, x is B- 700 


— a rr r aa 


(a) Summations 
Ey 11542 Ixy 533897-0 £y? 565529 
n 24 Ex 1133-2 Ex? 5483 
(b) Coefficients b, and b, 
D = nx? 一 (Ex)? = 31894-40 Din = 1328-933 
b, = (nZzy — LD = — 265866-4/31894-40 = — 8-335833 
b, = ( — XEzXzy-4-Xz*Yy))D = 27891873-72/31894-40 = 874-5069 
Check nb, Lb. = 11541-9996 = Xy 


(c) Standard deviations 


Ly? 5655294 
(C) 5550740 
—b? D/n 92342 
= xv 12212 
s? = Xw*/(n—2)- 555 s = 23-6 


s(b,) = s/J(D[n) = 8/36-5 = 0-65 


TABLE 12.26 
The fitted values u; and the residuals v; 


Ui v; Ui Vi Ui Vi 
399 +55 437 — 49 527 +3 
403 T17 444 +11 537 +1 
404 +8 458 十 33 552 — 14 
406 +1 468 — 29 560 — 21 
412 一 25 484 +2 568 —4 
417 一 3 494 一 18 568 十 22 
423 一 35 504 — 14 569 +9 
429 +9 512 +18 570 +20 


SUM 11545 —3 
EX»? 12247 


12.3 A POLYNOMIAL CURVE—CALIBRATION 
OF A PRISM SPECTROMETER 


The positions of spectral lines on a photographie plate can be 
found with the aid of a microscope which is moved across the 
plate by a micrometer screw. It is necessary to find a formula 
giving the wavelength À of a line in terms of the micrometer 
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screw setting d. This will be the formula for the regression curve 
of À on d, and it can be found from a series of observations of 
these quantities. 

Table 12.3 gives the readings obtained for seven standard iron 
lines in the violet region of a spectrum taken with a constant 
deviation spectrometer. It will be noted that the wavelengths A 
are free from experimental error, but the values of d, which 
corresponds to the independent variable, are subject to error. 
Since the curve required is a calibration curve, no special pro- 
cedure is necessary to take account of the errors in the inde- 


pendent variable. 
TABLE 12.3 
Positions of standard iron lines on a photographic plate 


Wavelength À (A. U.) Micrometer Reading d 


4045-81 18-9840 
4198-31 18-0049 
4307-91 17-4000 
4383-55 17-0272 
4415-12 16-8793 
4736-78 15-6099 
4791-25 15-4338 
SUM 30878.73 119-3391 


It is hoped that a quadratic or cubic curve may prove satis- 
factory. The first step in determining these least-squares curves 
is the evaluation of the sums of powers and of the moments, as 
described in $ 7.1.1.1. To simplify the arithmetic a factor 104 is 
removed from A (y = 10-4)), and the origin of d is moved to 
17 (z = d—17). Table 12.3a gives the calculation of the quantities 
bj, = Lai xk and M, = Xaiy. The z column is a check column, as 
explained in $ 7.1.1.1. 

In Table 12.36 the Doolittle scheme of Table 7.2.3 is used to 
solve the normal equations, since this gives the coefficients for both 
the quadratic and cubic curves. A factor 10 has been removed 
from all the quantities entered from Table 12.3g to bring them 
nearer to unity. Since the curve is expected to fit the points very 
accurately, eight decimals have been retained throughout. 

The quadratic curve is u(x) = Eb, xi. The fitted values at the 
points of observation and the residuals v, are evaluated in 
Table 12.3c (cf. $ 7.2.5.1). An examination of the residuals 
shows them to be a few A.U. in magnitude, with a systematic 
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variation which is of the form of a cubic curve. It appears, 
therefore, that the observations cannot be represented satis- 
factorily by a, quadratic curve. 

Table 12.34 gives the fitted values and residuals for the 
cubic curve. The residuals are now appreciably smaller, but they 
still seem to show some evidence of a systematic variation. To 
increase the degree of the polynomial further would make the 
formula for A too complicated for practical use. Probably the 
best procedure is to use the quadratic curve in conjunetion with 
a graph giving an additional small correction term. Such a graph 
could be obtained by measuring more standard lines of known 
wavelength in the region, determining their deviations from the 
quadratie, and drawing a smooth curve through these deviations. 


TABLE 12.30 


Calculation of moments and sums of powers 


Factor removed: , 107, 1 = 4 


の 9 * a xs y z 
1 1-9840 3-93625600 7-80953190 0-404581 15-13436890 
1 1.0049 1:00982401 1:01477215 0-419831 4-44932716 
1 0-4000 0-16000000 0-06400000 0-430791 2-05479100 
1 0-0272 0-00073984 0-00002012 0-438355 1-46631496 
1 — 0-1207 0-01456849 一 0-00175842 0-441512 1-33362207 
1 — 1-3901 1.93237801 一 2.68619867 0.473678 — 0-67024266 
1 — 1-5662 2.45298244 —3:84186110 0-479125 ー 1-47595366 
の M; C; Check 
の 9 4 0-3391 9-50674879 2-35850598 3・087873 22.29222777 777 
x 9-50674879  2-35850599 26-29087624 一 0.05333933 38-44189169 169 
x? 26-29087624 17-16050342 4-18278301 59-49941745 745 
x? 83-99821011 0-49929920 130-30739495 495 
y Ey? 1-36654431 9-08316019 O19 


14. ũñ I.LL L ——— a —— — —.. T r ua rm n 


12.3.1 Use of a special function 

Any continuous relationship between the two variables may 
be represented satisfactorily by a polynomial, but the degree of 
the polynomial required may be very high. It is often possible 
to find, either theoretically or empirically, a special function with 
a very much smaller number of parameters to represent the 
relation between the two variables. Sawyer (Experimental 
Spectroscopy, 2nd ed., 1951, Prentice-Hall Inc., New York, p. 240) 
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TABLE 
The Doolittle scheme 


Factors removed: y, 107, r = 4 ; elements divided by 105,52 1 


Boo 1 1. Enter doo 070000000  $,, 003391000 
Roo 1.42857143 | 2. — oo oss 1 ag, 004844286 
Roo goo Check 
3. Enter d,  0:95067488 
Qo, 十 0.04844286 4. 1 * oti 000164270 
Bo, — 004844286 fi 1 5. Subtract S, 094903218 
Ry) —0:05104449  R,, 105370505 | 6. +S), a, 1 
ZR $0; Check 
7. Enter 
cos 1.35810697 8. 1X & 
—0-00968810 a  0-19999026 9. 5X es 
Bos —1:34841887  f,, —0-19999026 822 1 10. Subtract 
Ro —1-03723583  R,, —0-15383726 R 076922376 | ll. 822 
ZR; Check 


4% 033692943 
013361723 a 275824403 
090471135 —0-13418194 a 067094237 

Boa +0°70139915 fy, — 262406209 8,4 067094237 Ba 1 

Roy +1-36197612 Ry, 一 5.09540095 Rss —1:30283517 Rs, 194179892 


ERa; Gos 
ao = boo — 0-44112471 
Bg 23 +0-00103582 a, —0-02138228 
bio 044216083 511 —0-02138228 
check Db is 65 
＋ 1 9。 —0:00308103 —0-00045696 a, +0-00228492 
bao 0439079580 ba, —0-02188924 b +0-00228492 
Check Eb, je 
+ Bia as — 0-00017844 十 0.0006675 十 0.00017069 a, 一 0.00025440 


bao 043890106 bg, 一 0.02117168 bsa --0-00245561 bs, 一 0.00025440 
Check 255, 673 i 


12.3 A POLYNOMIAL CURVE 


12.30 
for Example 12.3 


oa 0°95067488 do, 0-23585060 
cos 1:35810697 «$4 0-33692943 


612 0-23585000 4,4 2-62908762 

0-04605341 0-01142528 
Sa, 018979719 S5, 261766234 
al 019999026 413 2.75824403 


622 2-62908762 623 1-71605034 


1-29111818 0-32031034 

0-03795759 0-52350697 
Soo 1:30001185 Sz, 0-87223303 
22 1 2g 0-67094237 
12. Enter $33 8:39982101 
13. 1 x aos 0-07946501 
14. 5 X 413 7.22015152 
15. 10 x agg 0-58521810 
16. Subtract S44 0-51498638 
17. 28323 «33 l 


Check 


M, 0.30878730 O, 2-22922278 
ao 044112471 c, 318460397 

397 
M, —0-00533393 OC, 3-84418917 


0-01495854 
41 —0-02029247 


a, —002138228 
M, 0-41827830 
0-41936618 

— 0-00405830 


A. +0-00297042 
a, +0-00228492 


M,  0-04992992 
0-10403953 
— 0•05597158 
0-00199298 
M, 一 0-00013101 


as 一 0-00025440 


0-10798993 


€, 373619924 
c, 3-93685201 
201 

C, 594994174 
3-02752300 
0-74720346 
€, 9-17521528 
c。 167322727 
729 


C, 13-03073950 
0-75109076 
10-30534925 
1-45944410 

€, 0-51485539 
e, 0-99974564 
560 


391 


Ey? 013663443 


Mao 0-13621371 
Evè 0.00044072 


AM, a, 0.00043390 
Ev? 0-00000682 


M,a, 0-00000679 
0-00000003 


Evi 


M, a, 0-00000003 
Xe ` 0-00000000 
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suggests for the present example the formula 
C 
À = d- 
where A,, C, and d, are constants. In terms of y and z, 
u(x) = by b,[(b — z), 


or fu(z)—b (b, — z) = 5. 


bs; 


bs; 


Approximate values b? of the three constants b; can be found 
from the readings (2,,4); (ze, 95), (T3, ys), for three lines in the 


bao 


0-43907950 


SUM 307355650 
Check 


TABLE 12.3c 


Fitted values and residuals for the quadratic curve 


— 0-02183924 
bei 2, 


— 0-04332905 
— 0-02194625 
— 0-00873570 
— 0-00059403 
+ 0-00263600 
4-0-03035873 
4-0-03420462 


+ 0-00228492 
bos 21 


+ 0-00899403 
+ 0:00230737 
+ 0-00036559 
+ 000000169 
+ 0-00003329 
+ 0-00441533 
+ 0-00560487 


Ug (. 


0-40474448 
0-41944062 
0-43070939 
0-43848716 
0-44174879 


0-47385356. 


0-47888899 


———————————, 
0-43907950 


Uzi 


— 0-00016348 
+ 000039038 
+ 0-00008161 
— 0-00013216 
— 0-00023679 
— 0:00017556 
+ 0-00023601 


TABLE 


—0-00740568  --0-02172217 3-08787299 
Evi, 


12.3d 


Fitted values and residuals for the cubic curve 


0-43890106 


bso 


0-43890106 


— 002117168 


531 2; 


— 004200461 
— 002127542 
— 000846867 
— 000057587 
+0-00255542 
+ 0-02943075 
+ 0-03315909 


+ 0-00245561 


2 
6。 21 


0-00966591 
0-00247973 
0-00039290 
0-00000182 
0-00003577 
0-00474517 
0-00602357 


— 0-00025440 
baa 2 


— 0-00198674 
— 0-00025816 
— 0-00001628 
— 0-00000001 
+ 0-00000045 
+ 0-00068337 
+ 0-00097737 


Us (t) 


0-40457562 
0-41984721 
0-43080901 
0-43832700 
0-44149270 
0-47376035 
0-47906109 


+ 0-00000001 
34-584 x 10-5 


93: 


+0-00000538 
— 000001621 
— 0-00001801 
4- 0-00002800 
+ 0-00001930 
— 0-00008235 
+ 0-00006391 


Sa 
SUM 3:07230742 
Check 


— 000717931 


0-02334487 


— 0-00060000 


3-08787298 


Dv? 
2081 


+ 0-00000002 


1:264 x 10-8 


——————————————————  —— vv vv 
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spectrum. It can be shown that 
b = {21 yia — Vs) + *ays(s — Y1) + s Ya(Y1 — Yo)}/D 
and 52 = — (x, (Zs 一 3) + Xo Jy (5 — L1) + xs Ys (xy —25))/.D, 
where D = zi(ys — ys) Te — Y1) T, — Yo). 
Once bj and 6} have been evaluated, 
bY = (y, —b0) ( — 2). 


From the calculations in Table 12.3.1, the following three 
approximate values are obtained: 


69 = 0-250069, 09 ニー1.6856。 59 = —8-9249. 


TABLE 12.3.1 


Calculation of the approximate values b9 


£a — 1-5662 Yı — Yz — 0-033774 Zi 一 Za 1-9568 * Ya 一 0.75040558 
z,  1:9840 — % 7 —0-040770 Za 一 Za  1:5934 11 7/1  0:80268870 
a 00272 Yys—y, 0-074544 . — m, — 3-5502 TaY 001192326 


D = Ex; (J-) = — 00259632444 

b} = + Ex; Yi (y3—Yx)/D = —0:0064926127/D = + 0-25006939 

bg = , / (T -r = --0:2317194/D = — 8-924902 

b? = (yı — 58) (68 —2,) = —0-15451161 x 10-908902 = — 1-6855520 


As in $ 10.2.3, the linear variables 

Ou(x)|0b, = 1, 

z, = @u(z)|0b, = 1/(68 — z), 

x, = Bu(z)12bs = —b9?J(b9 a, 


y! = y— w(x) ニタ ー66 一 9/(8 一 ヶ ), 


R 
° 
lI 


are introduced. The least-squares corrections b; to the values 5j 
are found by solving the normal equations for y' as a linear 
function of the z; The normal equations are calculated in 
Table 12.3.12, and the solution using the scheme of Table 7.1.8 
is found in Table 12.3.15. 

It is apparent that the value b, is not at all well determined, 
since S and M, are both small. The normal equations are said 
to be ill-conditioned. The variations of z; and z; with z are very 
similar, and so a change in the value b, may be compensated by 
an opposing change in the value bi, and a large range of pairs of 


394 POLYNOMIALS AND OTHER CURVES 


values b, be can be found which satisfy the normal equations 
almost equally as well as the exact solution. The value b; actually 
obtained is very susceptible to round-off errors—errors due to 
retaining only a fixed number of decimals throughout the calcula- 
tion. Small changes in the observations also cause very large 
changes in the value bz. 

Since it is only a calibration curve which is required, this 
indeterminancy in the value of b; is of no importance. Adopting 
the values b; found in Table 12.3.15, and restoring the powers of 
ten by multiplying by 10'10-?, the least-squares values of the 
constants are 


0-250069 + 0-000109 = 0-250178, 


S 
ll 


b, = — 1:6856 + 0-001125 = — 1-684475, 
b, = — 8:9249 — 0-0002 = — 8-9251, 
and the least-squares formula for A is 


sno, 1084-475 
The fitted values for the observed lines are listed in Table 12.3.1c. 
It is seen that the sum Sv? is about half that for the cubic curve 
(Table 12.3d), while there are only three constants as against 
four with the cubic curve. Hence the special function gives a 
considerably better fit. 


TABLE 12.3.1g 


The normal equations for the least-squares corrections to the values b9 


z be- |z z 
1:9840 —10-9089 | 1 | — 0-916683 | +1:416423 — 0-04 1-459740 
1.0049 — 9-9298 | 1 | —1-007070| +1-709519 4- 0-10 1-802449 
0-4000 —9-3249| 1 | — 1-072398 | +1-938502 ー 0-41 1-456104 
0.0272 一 8.9521 | 1 | — 1-117056 | +2:103315 — 0-05 1-936259 
一 0.1207 — 8.8042 1 | —1:135822| --2-174579 ー0-11 1-928757 
— 1:3901 —7:5348| 1 | — 1327175 +2-969004 — 1-00 1:641829 
一 1.5662 — 7-3587 | 1| —1:358936| 十 3.112809 — 0-06 2-693873 
SUM oi M, C, Check 
十 0.3391 —62-8134| 7 — 7-935140 +15-424151 — 1-570000 12-919011 011 
9-150541 一 18-088813 十 1-965148 一 14-908264 264 


36.343792  — 4-180633 29・498497 497 


Zy? 1-197900 —2:587585 


585 


2 
Q 
M 
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990815*-0— = ttg taz 99dO 
898680.T 十 9 = 
986?Z6.0 一 "D+ 


6009&[ エ 十 79 = g6Z91-1 + i = 
9L9861:[1+ W+ 
ZE9LTO-0 — a ZL9890:0 — 1988£0-0 + 29 * — 
=a p 
892286 xou?) 
68811600 * — eg9LI0:0— の 1 * “g+ II 
9110000 2 . *10000-0— % 640000 “S gonagqng ‘OT 
98FZ01:0 LOIZLO-0 — 196585 ·0 *g 6 
L¥PZ90-0 d 689978 · 8569 5E ·0 一 89868.8 x Ig 
000000-0 °2'°p — 0986106: “O 2908150 HW 6Le$£9-g “E Iug `L 
L0S9 ou 
1499691 o 97986LT 十 W — c80088.g— ""» t = 19. 9 
6££920-0 — '» I9810-0-- "° €IF090:0— "s — se9e100 "gy gowngqug '9 
/FS90.0 aR L8FP9F:I 一 PLOLLI-O+ SOPSFL+I — 039668-0 Do x 1 °P 
O8 1880-0 Up mm — 9c806P1— 'O — GSI9961:0+ Ç — 188808&-1— "$ 90916.0 — "$ regung 'g 
819 No] 
1195800 bag 8199f8.T "2 988788˙0— % — oepgocc- "9 1698811 — W» I 000 hi 8 
gege- ° p  TO6GIGZE „% — 000L.0L.0— "pp — QIPGPS'I+ "$ — »19e610— Vo 00000 "9 eu! 
06161100 sfx I = $ 9I £q pəptarp sqjueuiee [y 
01 = OT 2-01 1-01 一 = £I : peAourei 
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TABLE 12.3.1c 


Fitted values for the observed lines 


d À fitted Residual の 
18-9840 4045-89 — 0-08 
18-0049 4198-13 + 0:18 
17-4000 4308-17 — 0-26 
17-0272 4383-39 +0-16 
16-8793 4415-00 +0-12 
15-6099 4737-30 — 0-52 
15-4338 4790-80 + 0:45 

SUM 30878-68 + 0-05 
xv? 0-6193 


12.4 POLYNOMIAL WITH EQUALLY-SPACED 
OBSERVATIONS—VARIATION OF VISCOSITY 
OF WATER WITH TEMPERATURE 
Table 12.4 gives the viscosity of water y at temperatures ¢ in the 
range 0(1)20? C. It is desired to fit a polynomial to these values 
so that the viscosity at any temperature in this range can be 
accurately determined. 


TABLE 12.4 


Viscosity of water y (centipoises) at temperature t? C 


i y i V t y 
0 1-7921 ri 1-4284 14 1-1709 
1 1-7313 8 1-3860 15 1-1404 
2 1-6728 9 1-3462 16 1-1111 
3 1:6191 10 1-3077 17 1-0828 
4 1-5674 11 1-2713 18 1・0559 
5 1:5188 12 1-2363 19 1-0299 
6 1:4728 13 1-2028 20 1-0050 
SUM 28-1490 


A cubic is first fitted, using the scheme of Tables 7.6.2.2 and 
7.6.2.1a, in which the variable ¢ is replaced by the special variable 
e —t—1. The calculations are given in Tables 12.4a and 12.4b. 
The sums and differences are formed in Table 12.43, and the 
moments MV, are calculated by multiplying these by e and sum- 
ming. The moments are entered in Table 12.45, together with 
the values Si and fp; from Table 7.106, and the orthogonal 
coefficients a; and the power-series coefficients ba; are calculated. 


a; = M,/S;; 


M, 


Go 
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TABLE 12.4a 


Calculation of moments 


M; = Ze! [y+ - (7) y-] 


0 1:3077 

H — 0-0749 1:2713 1:3462 23-6175 
2 — 0-1497 1-2363 1-3860 2-6223 
3 — 0-2256 1-2028 1-4284 2:6312 
4 — 0:3019 1-1709 1-4728 2:6437 
5 — 0-3784 1-1404 1:5188 2-6592 
6 — 0-4563 1-1111 1-5674 2-6785 
7 — 0-5363 1-0828 1-6191 2-7019 
8 — 06169 1-0559 1:6728 2:7287 
9 — 0:7014 1-0299 1:7313 2:7612 

1000 10 1-0050 1-7921 


11:3064 15-5349 26-8413 


yo 1・3077 


TABLE 12.45 


Evaluation of coefficients 


— 36-6r = — 110/3 
.8 


Xy? 38-90059014 
十 0.001317113 
一 0.038651169 
一 0.037334056 


a, 4% 37.73172386 
Ses — 1-16886628 


28-1490 


= Mo 
1-34042857 


Gs = bs, — 0-000020016912 


M, = A, 
a, 


M. 
+Ë M, 


Ma 


— 29-7614 


— 0-038651169 


1052-3898 
— 1032-13 
20-2598 


a, M, 
wi 


a, Ma 
と の 3 


0-00090313828 


— 1970-7704 
+ 1958-30012 
— 12-47028 


— 0-000020016912 


1-15031290 
0-01855338 


0-01829740 
0-00025598 


0-00024962 
0-00000636 


aa = baz 


Boo a2 
十 Co 
= by 


+ 0-00090313828 


— 0-03311507 
1:34042857 
1:30731350 
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Table 12.4c shows the calculation of the fitted values and the 
residuals » for the cubic curve. The scheme is explained in 
§ 7.6.2.3, the basic formulae being 


" 


u” = by eb, €, 1 = bso + bos e°, 


u, = u +w”, u_=u'—u". 

An examination of the residuals shows a pronounced systematic 
variation, and it appears that a polynomial of higher degree is 
required. 


TABLE 12.4c 


Evaluation of residuals for the cubic curve 


Odd powers 
by, —0-037334056 


bsa 一 0-0000200169 


* 


bzo 13073135 
bza 0-000903138 


€ u Usa 934 Vz- Uz- u 
0 1-307314 + 0-000386 
1 一 0.037354 . 1-270863  4-0-000437 十 0.000629 1-345571 1-308217 
2  —0-074828 1-236098 +0-000202 +0-000246 1:385754 1-310926 
3 一 0.112543 1.202899 一 0.000099 +0-000415 1:427985 1-315442 
4 一 0.150617 1171147 —0-000247 +40-000419 1-472381 1:321764 
5  —0-189173 1-140719 一 0.000319  —0-000265  1:519065 1-329892 
6 | —0.228328 1-111498 — 0-000398  —0-000754 1568154 1-339826 
7 — 0268204  À 1.083363 — 0-000563 — 0-000671 1-619771 1-351567 
8 — 0.308921 1-056193 一 0-000293  Á—0-001235 1-674035 1-365114 
9 — 0350599 1-029869 +0-000031 +0-000233 1731067 1.380468 
10 — 0393357 1-004270 +0-000730 十 0.001116 1.790984 1-397627 
SUM — 2.113924 11-306919 — 0-000519 +0-000133 15-534767 13-420843 


It is simplest to use the tables of the orthogonal polynomials 
Ti(e) to investigate the decrease in the residuals for polynomials 
of higher degree. The values of T;(e) and Tze) (for positive e) 
are entered from the tables of Fisher and Yates (1948) in Table 
12. 4d. The moments M, and M; are calculated by multiplying 
these columns by the sum and the difference columns of Table 
12.4a respectively. The orthogonal coefficients a; and the sums 
I$ = Ev _ı— ap Mp are calculated. The individual residuals are 
found from the formulae 


Va = vg d Tile), Vs} =V — a Tyle), vg. = v, +05 Tile). 


It is clear that the addition of a quartic term a! T: (e) consider- 
ably reduces the residuals. The residuals v, still show evidence 
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TABLE 12. 4d 
Residuals for fourth- and fifth-degree polynomials 


Factor 105 removed 
ag Ti (e) s+ Us~ 


Factor 109 removed 
Ti (€) | ad Ta (€) 4 - 


Ts (e) 


+556 一 170 0 一 170 


十 506 一 69 十 123 


1 + 1404 一 97 十 28 十 26 
2 +361 一 159 —115 | +2444 一 168 +9 一 283 
3 十 140 一 239 十 275 | 十 2819 一 194 一 45 十 81 
4 —122 —125 +541 4 2354 —162 +37 +379 
5 —380 +61 +115] +1063 —73 +134 +42 
6 一 576 +178 一 178 — 788 +54 十 124 一 124 
7 — 637 T74 ー34 | —2618 +180 一 106 4-146 
8 一 478 十 185 一 757 | —3468 十 239 一 54 一 518 
9 O +31 十 233 | — 1938 十 134 一 103 十 367 
10 十 907 —177 十 209 | 十 3876 一 267 十 90 一 58 


—279 —240 7412 +5148 — 354 +114 +58 
Dv? 1352828 Lv? 775152 


8 


(1-10) 


= 274 (e) = +5:3565 

84. = 5,720,330 

a, = M/S, = 093639703 x 10-8 
a, & = 502 x 10-8 

Lv} = 134 x 10-8 


EyT; (<) = —8-3840 
$ 121,687,020 

ag = Mu Sss = —6:8898063 x 10-8 
as Mg = 58x 10-8 
Zes = 76 x 10-5 


II l! 


of a systematic trend, and so it is probably advisable to use the 
fifth-degree curve, where the residuals are more random. 
The power-series coefficients bs; for the fifth-degree curve 


5 
AG) = b bs; e 
j=0 


may be obtained by adding 8;,a;--B;,a; to the cubic coefficients 
52% where the B; are tabulated in Table 7.10c. The values obtained 
are listed in Table 12.4e. 


TABLE 12.4e 
Evaluation of power-series coefficients for the fifth-degree polynomial 


KK, 0-525 Bisag 3·617  x10-3 bss —0-0000000362 
: 0-583r 84. a4 --0-546232 x 10-6 b, 4-0-000000546 
Bis 一 63.29167 835 a5 ＋ 4.360673 K 10 bs, —0-00001506 
Bu 545837 Baag —5:111167 x 10-5 5 + 00008520 
Bis + 1466-762 Bisag —1-010574x10-* 551 一 0.037435 
Bos +594 Bb a4 +5°562198x 10-4 — bj, 1-30787 
Check Xb,,10/ = 1-00490, v, (+10) = + 0-00010 

Obe, (— 10): = 1-79216, v, (— 10) = 一 0.00006 
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If it is assumed that the residuals in Table 12.4d are due to 
random errors of observation, the quantity 


85 vg / (u- 6)}} = (77-5 x 1079/15): = 2-27 x 107* 


will provide an estimate of the standard deviation of an observa- 
tion. The standard deviation of a fitted value will be given by 
the formula ($ 8.4.2) 


s[us(e)] = (55/4 m) pso(k, n) = (0°50 x 107) pso( n), 


where k is 2|e|/» and ps(k,n) is tabulated in Table 8.84. For 
example, when e is + 10, k is 0-95 and p59(0-95, 21) is 4-1, and so 
the standard deviation of the fitted value is 0-00020. For most 
of the temperature range the rough approximation ($ 8.4.3) 
2-2 s;/,/n = 0-00011 will be adequate. 

The polynomial has been obtained in terms of the variable 
e— ti = t- 10. If the polynomial 


5 
us(t) = È Csi の 
J= 


in terms of the variable t is required, a change of origin is neces- 
sary. This may be accomplished by the scheme of Table 7.4.1. 
The value g is e- t, here equal to — 10. It is convenient to reduce 
the scale of the variables e and ¢ by a factor 10, so that the 
coefficients 55, are increased by a factor 107 and so are all of the 
same magnitude. This changes the value of g to 一 1. The calcula- 
tions are shown in Table 12.4 た The fitted polynomial is 


us(t) = 1-7922 — 0-6317 x 1071£-- 0-2011 x 102 
— 0-0737 x 10-313 + 0-0236 x 10-471 — 0-0036 x 10-5 15. 
TABLE 12.47 


Polynomial expressed in terms of the variable t, us(t) = と cs, が 


Factor 107 removed from 55% g= —1: multiply 5,; by the power kg" shown 


bso 557 bsa bg, bg, bss 
130787 | 一 0.37435 +0-08520 —0:01566 十 0.00546 一 0.00362 


1 1-30787 | 8 十 0.37435 | g? --0-08520 | 83 +0-01566 | g* 十 0.00546 | 85  --0-00362 1:79216 
1 —0-37435 | 2g —0-17040 | 3g? —0-04698 | 4g? —0-02184 | 584 —0-01810 | —0-63167 

1 十 0.08520 |3g +0-04698 | 6g? 4-0-03276 | 10g? +0-03620 | +0-20114 

1 —0-01566 | 4g —0-02184 | 10g? —0-03620 | —0-07370 

1 十 0.00546 | 5g 十 0-01810 | +0-02356 

1 —0-00362 | — 000362 


Check Zcsj( 一 9)7 = 1.30787 = bso 
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12.5 A LINEAR FUNCTION—VARIATION OF VAPOUR 
PRESSURE OF ETHYL ALCOHOL 


WITH TEMPERATURE 


Table 12.5 lists the vapour pressure p of ethyl alcohol at tempera- 
tures t in the range 0(5)50 C. Kirchhoff derived a formula, 
discussed in textbooks on heat, for log in terms of the absolute 
temperature T = t+ 273-16, of the form 


log p = À — BJT — Clog T. 


TABLE 12.5 


The vapour pressure p of ethyl alcohol (mm. of Hg) 


at temperatures t? C 


p i p 
12-24 30 78-06 
17-31 35 102-60 
23-78 40 133-70 
32-44 45 172-20 
44-00 50 220-00 
58:86 

SUM 895-19 


TABLE 12.5a 


Calculation of quantities occurring in the normal equations 


t Xo 2 * y z 
0 1 0-660858 — 0-38583 0-087781 1-362809 
5 1 0-595053 — 030705 0-238297 1.526300 
10 1 0-531572 — 0-22968 ` 0-376212 1-678104 
15 1 0-470294 ー0-15366 0-511081 1:827715 
20 1 0-411107 — 0-07895 0-643453 1-975610 
25 1 0-353904 — 0-00551 0-769820 2.118214 
30 1 0-298588 + 0:06672 0-892428 2-257736 
35 1 0-245068 + 0-13776 1-011147 2.393975 
40 1 0-193256 + 0-20766 1-126131 2.527047 
45 1 0:143073 + 0-277646 1-236033 2-655566 
50 1 0:094442 + 0-34418 1-342423 2-781045 
の M, C, Check 

11 3-997215 — 0-127900 8-234806 23-104121 121 

1-804774 — 0-500581 2.212646 7-514054 054 

0-587214 0-909419 0-868152 152 


xy? 7-890779 19.247650 650 
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To find the values of the constants A, B, and C in the present 
example, this equation is first converted into the form 


u(x) = bo * 4- b, 41 + b,;, 
where 


* = 1, x, = (771—0-003)x103, z, = (logy, T — 2-475) x 10, 


y = log;op — 1, 
the new variables being chosen so that their values at the points 
of observation are all of the order of unity. 

The quantities occurring in the normal equations are calculated 
in Table 12.5a, z being as usual the check column. The solution 
of the normal equations is carried out in Table 12.5b. It will be 
seen that Sz and M, are both very small. The equations are ill- 
conditioned; there is a considerable range of pairs bi, bz which 
satisfy the equations almost as well as the exact solution, and the 
values obtained are very susceptible to round-off and observa- 
tional errors. That this would be so is apparent from Table 12.5a, 
since, over the range of values of t, z, and z, both vary roughly 
linearly with ¢. Only over a much larger range of ¢ would it be 
possible to distinguish between the two variables. It is simplest 
to omit the variable z,, and use the form 


The values b, and b, are calculated in the ‘backward’ section 
at the bottom of Table 12.55, and the fitted values and residuals 
in Table 12.5c. The fitted pressures are given by 


log, P = 1+ u(z;) 
= 2-553000 — 2-213591 (T-! — 0-003) x 103 
2213-591 
Ns 
This formula will be suitable for the prediction of the vapour 
pressure at a given temperature, but the coefficient of 1/T will 
not be an estimate of the constant B in Kirchhoff's formula. 


For small variations f about T, such that powers of /I may be 
neglected, 


= 9-193773 一 


To 


= (14-2/75)3 = 1—1[T,, 


Ty t 
log, (Ty +t) = log, T, log. (1 +t/Z) = log, To +tJT, 
= log, T, + 1 — / (Ts +t), 
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and the Kirchhoff formula becomes 
log p = A' — B'|T, 
where | 4'— A—C(log T, +loge), B. = B CTlog e. 
It is the quantities A’ and B' that are estimated when the log T' 
term is omitted from the Kirchhoff formula. 


TABLE 12.50 
Fitted values and residuals 


50 1:5530005, b, — 2-213591 


t u(x) v I p-P 
0 0-090131 — 0-002350 12-306 — 0-066 
5 0-235797 4- 0-002500 17-211 + 0-099 
10 0-376318 — 0-000106 23-786 — 0-006 
15 0-511962 — 0-000881 32-506 — 0-066 
20 0-642978 4- 0-000475 43-952 4- 0-048 
25 0-769602 + 0-000218 58-831 + 0-029 
30 0-892049 + 0-000379 77-992 + 0-068 
35 1-010520 +0-000627 102-452 +0-148 
40 1-125211 + 0-000920 133-417 + 0-283 
45 1-236295 — 0-000262 172-304 — 0-104 
50 1-343945 — 0-001522 220-772 — 0-772 
SUM 8-234808 — 0-000002 895-529 — 0-339 

xv? 16-60 x 10-5 


The formula which has been fitted is the simple least-squares 
formula for the values y, each value y being assumed to have 
the same weight. This would correspond to the assumption that 
the standard deviations in the values p are proportional to p, the 
percentage standard deviation being the same at all temperatures. 
If it were assumed that the standard deviations were the same 
at all temperatures, then 

var , lo Jv : 
y = (= gp arp UB, 
and the weight attached to each observation would be propor- 
tional to p?. The values in the columns % J, 2, of Table 12.5g 
would then be multiplied by some factor proportional to p (say 
107?p5) and the resulting columns intermultiplied to give the 
normal equations. 

It is found that the straight line obtained by this method is 
determined almost entirely by the observations at the higher 
temperatures. The residuals at all temperatures from 0? to 30? 
are negative. This would seem to indicate that the weighting is 
much too severe, and that equal weights for the values log p are 
more appropriate in fitting Kirchhoff's formula. 
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12.0 A NON-LINEAR FUNCTION—THE COUNTING 
RATE OF A TYPE I COUNTER 


When the average rate of occurrence of events is unity, the 
average number N(t) of counts in time t, given that the counter 
is free at time ¿= 0, may be calculated from the asymptotic 
formula 
Nii) = t 7 
07 Tyr" aaa 

where 7 is the resolving time of the counter. Table 12.6 shows 
the divergences V(t) of the asymptotic formula from the true 
values when 7 has the value 0-2. It is desired to find a formula 
which will represent this variation adequately. One possible form 
which suggests itself is 


u(t) = e-M(oat* — BI? + y). 


The least-squares values for the constants in this formula will 
now be determined. 


TABLE 12.6 


Divergences V(t) of the asymptotic formula for N(t) from the true 
values for a type I counter with + = 0-2. A factor 10-? has been 
removed from V (t) and a factor 10 from t 


t V (t) LN V (t) 
0-0 +1:3889 1:6 — 0-0634 
0-2 +1-0755 1-8 — 0-0841 
0-4 +0-8011 2-0 — 0-0713 
0-6 + 0-5654 2:2 — 0:0456 
0-8 +0°3672 2-4 — 0-0263 
1-0 +0-2059 2-6 — 00121 
1-2 + 0-0809 2-8 — 0-0029 
1:4 — 0-0086 3-0 + 0-0028 


SUM +4:1734 


It is first necessary to obtain approximate values for the con- 
stants. If the zeros of V(t) are assumed to be at t, = 1-4 and 
t, = 2-9, then from the theory of quadratic equations 


Bla = + = 10-37, „/ = Èt = 16-4836. 


At t= 0, u(t) is just y, and so y may be taken as 1-3889. Using 
this value of y, estimates of x and B follow. At t = 2, 


u(2) = e-? (16a — 48 +y), 
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which gives, on equating this expression to V (2), the value 1-182 
for À. The first approximations which will be adopted are 

f? = b} = +0-874; a? = b} = + 0:0843; 

P = b} = + 1-18; y? = b} = +1-389. 

From $ 10.2.3 the least-squares adjustments b; to these values 

are found by solving the normal equations 
zy 一 3 aj) z = 0, 

where xg = &u[0B = - e, xi = duſd = tte, 

x, = の / = —te^M(at* — BE +y) = — tut), 

x, = @u|0y = e, y'= It) - ust), 
the first approximations being used to calculate the values , y’. 
In Table 12.6a the values 25,25, i 1 (t), æ, and y' are calculated 
in that order, and the columns are intermultiplied to give the sums 
for the normal equations. It will be noted that the correction to y 
is labelled bg. This is because it is hoped that this correction will 
prove negligible. Ifthis variable appears last in the Doolittle scheme 
it can be dropped without affecting the previous calculations. 

Table 12.65 gives the solution of the normal equations. It is 
apparent that the inclusion of the variable xj, causes only a very 
slight reduction in 2%2, and so this variable may be omitted and 
the equations solved for 50, bi, and b+. Restoring the 10-? factor 
removed from y’, the least-squares values are 

a = b? + b, = 0-0843 + 0-00637 = 0-09067; 
B = b8 +b = 0-874--0-0038 = 0-8778; 
A = 6946) = 1-18—0:0728 = 1-1072; y = 1.3889. 

Table 12.6c shows the fitted values u(t) and the residuals v(t) 
obtained with these values for the constants. The sum X*(t) is in 
reasonable agreement with the value obtained in Table 12.6b. 
Some divergence is to be expected when a linearization procedure 
is used. The residuals 

v(aj) = y Eb; a 
are also shown in Table 12.6c, and it is found that Xw*(z;) agrees 


almost exactly with the value in Table 12.65. From the normal 
equations, 


Ev(zj) zy = Uy’ — Eb; x) x = 0, 
and the sum of the residuals will only vanish if one of the variables 


x, is constant at all points of observation. Since this is not so 
here, Xv(z;) is different from zero. 
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12.0 A NON-LINEAR FUNCTION 
TABLE 12.6c 


The fitted values and the residuals 


Non-linear function 


Factor removed: 


etstotototo" ピ ピピ ビビ oO どら どら で 
OO O > t5 O = to O Ç O; i> to O 


u(t) 


1-388900 
1-084993 
0-803226 
0-558182 
0-356415 
0-198875 
0-082862 
0-003551 
— 0-044909 
— 0-068603 
— 0-073349 
— 0-064387 
— 0-046222 
— 0-022574 
+ 0-003605 
4- 0-030066 


+ 4-190631 
Zw*(t) 


v(t) 


0 
— 0-9493 
—0-2126 
十 0.7218 
+ 1:0785 
十 0.7025 
一 0.1962 
— 1:2151 
— 1:8491 
— 1-5497 
+ 0-2049 
+ 1:8787 
+ 1:9922 
T 1:0474 
— 0-6505 
— 2-7266 
— 1:7231 
26-9546 


Linear representation 


10-? 
u(x) 


0 
+ 15450 
+ 2-2436 
十 2.3070 
1-1:9637 
+ 1:4186 
+ 0:8344. 
+ 0.3258 
— 00369 
一 0.2210 
一 0.2227 
— 0-0583 
+ 0.2437 
+ 0:6481 
+1-1186 
+ 1-6207 


+ 13-7303 
Zv? (x) 


10-2 
v(z;) 


— 0-0100 
— 0-9452 
— 0:1850 
+ 07688 
+ 1:1343 
+ 07562 
— 0:1521 
— 1:1821 
— 1:8229 
— 1-5203 
+ 0-2516 
+ 1-9590 
+ 2-1227 
+ 1-2441 
— 0-3741 
— 2-3599 
— 0-3149 

26-0957 
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